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CHAPTER  1 


INTRODUCTION 


1.1  Problem  Definition 

In  this  report  we  consider  the  integer  programming  problem  (p)  as 
defined  by  (l)-(5): 

(?)  .axiMze  * c(2)x<2>  * ...  * c(l,,x(B)  , | 


subject  to 


A(1,x(1)  + A(2)X<2)  + •••  + A(B)x<B)  <b 


B<2)x<2> 


<Pd> 

<e<2> 

,(«,(»>  < p(»> 


,(J)  > 0, 


for  j = 1,  2,  . . . , N 


integer,  for  j = 1,  2,  ...  , N , 


where  b is  an  m-vector  and,  for  each  j = 1,  2,  ...  , N,  cVJ;  and 

x^  are  n -vectors,  0^  is  an  m -vector  and,  correspondingly, 

J J 

A ^ is  an  m x n^  matrix  and  is  an  m^  X n^  matrix.  Because 

of  its  special  structure,  it  is  natural  to  consider  problem  (P)  as  con- 
sisting of  N almost  independent  subproblems  (1),  (3),  which  could  be 
solved  separately  except  that  they  are  tied  together  by  the  linking 
constraints  (2).  Mathematical  programming  problems  in  which  the  con- 
straint matrix  takes  the  form  above  have  commonly  been  referred  to  as 
"block  angular." 


1 


1.2  Integer  Programming:  State  of  the  Art 


The  field  of  integer  programming  has  progressed  greatly  since  its 
inception  in  1958  when  Gomory  first  proposed  a method  for  generating 
integer  solutions  to  linear  programs.  In  the  intervening  period  of  less 
than  20  years,  numerous  general-purpose  integer  programming  algorithms 
have  been  developed,  and  several  commerical  computer  codes  have  been 
marketed.  The  result  is  that  the  solution  of  integer  programming  problems 
which  arise  in  the  course  of  industrial  and  military  decision  making 
processes  now  has  become  a relatively  routine  occurrence. 

The  many  integer  programming  algorithms  which  have  been  proposed 
seem  naturally  divided  on  the  basis  of  their  underlying  theoretical 

t 

foundations  into  three  major  categories:  cutting  plane,  group  theoretic, 

and  enumerative.  Cutting  plane  algorithms  (see  Gomory  (1963),  and  Martin 
(1963))  proceed  by  first  solving  the  linear  programming  (LP)  relaxation 
of  the  integer  programming  problem.  If  the  optimal  LP  solution  satisfies 
the  (dropped)  integrality  restrictions,  this  solution  must  be  optimal 
and  the  procedure  terminates.  Otherwise,  a new  constraint  ("cutting 
plane")  is  generated  and  added  to  the  problem.  This  constraint  is  gener- 
ated so  as  to  render  the  previous  LP-optimal  solution  infeasible,  without 
eliminating  any  feasible  integer  solutions  to  the  problem.  The  revised 
LP  problem  is  reoptimized  and  the  new  solution  again  checked  for  inte- 
grality. By  properly  generating  the  additional  constraints  at  each  iter- 
ation, it  is  possible  to  ensure  that  the  procedure  will  converge  to  the 
integer  optimum  in  a finite  number  of  steps.  The  major  drawback  inherent 
in  cutting  plane  algorithms,  however,  is  that  no  feasible  integer  solution 
is  produced  until  the  last  step,  when  the  optimum  is  obtained.  As  the 


■ 


2 


number  of  iterations  required  can  be  quite  large,  this  aspect  must  be 
a serious  consideration  for  users  with  a limited  computer  budget  which 
might  necessitate  premature  termination  of  the  computations. 

Group  theoretic  procedures  comprise  the  second  category  of  integer 
programming  algorithms.  (See  Gomory  (1965),  and  Gorry  and  Shapiro  (1971).) 
The  group  theoretic  approach  begins  by  transforming  the  original  problem, 


maximize  cx  , 
subject  to 


Ax  = b 


x > 0,  integer  , 


into  the  equivalent  form, 


maximize  cx„  , 
N 


subject  to 


where  b 


= B_1b,  A = B-1N, 


xB  = b - Axw 
*B  > *N  > 0 

V XN  integer  * 


c = c_-  c B N > 0,  and  the  columns  of 

IN  13  — 


A have  been  partitioned  into  basic  and  nonbasic  sets  B,  N respectively, 
for  some  dual-feasible  basis  B.— ^ One  then  works  with  problem  (7)  in 
place  of  problem  (6).  This  approach  has  been  called  group  theoretic 
because,  dropping  the  nonnegativity  restrictions  on  the  variables  x , 

D 

(7)  can  be  shown  to  be  equivalent  to  the  group  problem, 


— Usually,  an  optimal  basis  B is  chosen,  though  this  is  not  necessary. 
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maximize  cx  . , 

N 

subject  to 

•#  * 

A x^  = b (mod  D) 
x^  > 0,  integer  , 


(8) 


^ -H-  

where  D = |det  b|,  A = D(A  - [A]),  b = D(b  - [b]),  and,  in  general, 
[y]  denotes  the  integer  part  of  y (i.e.,  the  largest  integer  not 
greater  than  y).  Specialized  and  efficient  solution  procedures  exist 


for  solving  problems  such  as  (8)  above. 


The  third  category  of  integer  programming  algorithms,  and  the  one 


which  has  received  the  most  attention,  consists  of  the  enumerative  pro- 
cedures. (See  Balas  (1965,  1967),  Dakin  (1965),  Geoffrion  (1969),  Glover 
(1965),  and  Land  and  Doig  (i960).)  These  methods  employ  a branch-and- 
bound  type  search  procedure  for  the  optimal  solution  to  the  integer 
programming  problem,  and  computational  experience  to  date  has  shown 
them  to  be  the  most  consistently  effective  of  the  three  types. 

Consider  again  the  integer  programming  problem  (6),  and  let 

Fq  = {x  > o|Ax  = b,  x integer) 

be  the  set  of  feasible  solutions  to  (6).  As  with  the  cutting  plane 
algorithms,  the  standard  first  step  in  an  enumerative  procedure  is  to 
solve  the  associated  linear  programming  relaxation  and  check  the  optimal 
solution  - call  it  x - for  integrality.  The  procedure  terminates  if 
x satisfies  the  integer  restrictions,  since  this  solution  must  then 
be  optimal. 

Usually,  of  course,  several  integer-restricted  variables  will  occur 
at  non-integer  levels  in  the  optimal  LP  solution,  and  further  analysis 


4 


is  required.  In  accordance  with  branch-and-bound  search  strategy,  the 


set  of  feasible  solutions  FQ  to  (6)  is  partitioned  into  (at  least) 

two  exhaustive  and  mutually  exclusive  subsets  F^,  Fg.  Most  commonly, 

the  partitioning  is  accomplished  by  specifying  new  bounds  on  one  of  the 

variables  which  violates  the  integer  restrictions  in  the  optimal  LP 

solution  x.  That  is,  some  such  variable  x,  is  selected,  and  the  sets 

k 

Fi,  F^  are  formed  by 

F-L  = F0O  txUk  < [xkD,  P2  = F0D  tx|xk  > [xk]  + 1)  . 


Thus,  two  new  problems  are  created: 


maximize  {cx|x  e F^)  , 


and 


maximize  (cx|x  e Fg)  • 


(9) 

(io) 


It  is  clear  that  since  F-j^Vj  F^  = FQ,  the  optimal  integer  solution  to 
one  of  these  problems  must  be  the  overall  optimum  to  the  original  problem 
(6).  One  of  these  problems,  say  (9),  is  treated  immediately,  while  the 
other  problem,  say  (10),  is  put  on  a list  and  stored,  to  be  returned  to 
and  considered  later. 

Problem  (9)  is  treated  in  exactly  the  same  way  as  the  original 
problem.  The  integer  restrictions  are  relaxed,  and  (9)  solved  as  a 
linear  program.— ^ If  the  optimal  LP  solution  satisfies  the  integer 
restrictions,  it  must  clearly  be  optimal  for  (9).  However,  as  the 
optimum  for  (9)  may  not  be  the  overall  optimum  for  (6),  it  then 


— In  practice  this  is  most  efficiently  done  by  applying  the  dual  simplex 
method,  starting  with  the  LP-optimal  basis  for  (6),  or  by  parametric  pro- 
gramming on  the  new  bounds. 


would  remain  to  return  to  the  list  of  partitioned  problems  - this  list 

so  far  contains  only  the  problem  (10)  - and  examine  each  in  turn  to  see 

if  there  exist  any  better  integer  solutions. 

If  the  optimal  LP  solution  to  (9)  does  not  satisfy  the  integer 

restrictions,  the  feasible  set  F^  is  itself  partitioned  in  a similar 

fashion  to  the  partitioning  of  FQ.  As  before,  one  of  the  two  associated 

problems  is  added  to  the  list,  to  be  considered  later,  while  the  other 

is  examined  next.  This  process  - reoptimization,  partitioning,  etc.  - 

is  continued  until  some  partitioned  set  F.  is  obtained  for  which  the 

J 

associated  LP  optimum  is  integer-feasible  as  well,  or  it  is  demonstrated 

that  the  optimal  solition  to  (6)  cannot  lie  in  the  set  F . • In  branch- 

<J 

and-bound  terminology,  the  partition  F.  is  said  to  be  fathomed,  and 

J 

at  this  point  a new  problem  is  extracted  from  the  list  and  the  search 

for  a better  integer  solution  to  (6)  is  continued  in  exactly  the  same 

way.  At  any  given  point  in  the  search,  the  best  integer  solution  found 

"so  far"  is  called  the  incumbent.  The  search  is  terminated  when  the  list 

of  partitioned  problems  has  been  exhausted,  and  the  final  incumbent 

solution  must  then  be  optimal.  (However,  if  no  incumbent  solution  has 

ever  been  obtained,  it  follows  that  (6)  must  have  no  feasible  solutions.) 

The  task  of  demonstrating  that  a given  partition  F.  cannot  contain 

J 

an  improved  integer  solution  to  (6)  is  accomplished  by  computing  bounds 

on  the  optimal  objective  value.  If  x is  the  current  incumbent  solution, 

the  corresponding  objective  value  cx  provides  a lower  bound  on  the  maximal 

value  in  (6).  Upper  bounds  on  the  maximum  objective  value  attainable  by 

any  feasible  integer  solution  in  a given  partition  F.  of  F are 

J M 

easily  derived.  The  optimal  objective  value  obtained  in  solving  the 


LP  problem  associated  with  F.  provides  one  such  bound.  If  this  bound 

J 


is  not  greater  than  cx,  the  partition  F.  is  fathomed,  since  then 


F.  clearly  cannot  contain  a better  integer  solution  to  (6)  than  x. 
J 


Alternatively,  F.  can  also  be  fathomed  if  the  associated  linear  program 


is  shown  to  be  infeasible,  since  this  in  turn  implies  F . = 0.  In  either 

1 


case,  the  analysis  of  the  partition  F.  is  complete. 


The  enumerative  procedure  outlined  above  can  be  conveniently  dia- 
grammed using  a tree-search  structure  in  which  each  of  the  nodes  represents 


a partitioned  subset  F..  (See  Figure  1.)  The  partitioning  process 

1 


is  represented  by  branches  in  the  tree  which  connect  a given  set  (node) 
to  its  two  partitioned  subsets  (descendent  nodes).  The  generic  name 
"branch-and-bound"  derives  from  this  visualization  of  the  procedure,  in 
conjunction  with  the  bounding  methods  discussed  above.  While  the  dis- 
cussion of  the  branch-and-bound  method  has  been  within  the  context  of 
the  integer  programming  problem  (6),  it  should  be  kept  in  mind  that 
this  type  of  "divide  and  conquer"  search  strategy  is  in  fact  much  broader 
in  its  range  of  applicability.  (See  Mitten  (1970)  for  a formulation 
of  the  branch-and-bound  procedure  in  more  general  terms.)  The  branch- 
and-bound  concepts  introduced  here  will  be  drawn  upon  again  in  a different 
context  in  later  chapters. 

In  addition  to  the  references  above,  introductory  expositions  and 
further  details  on  any  or  all  of  the  integer  programming  methods  discussed 
may  be  found  in  Garfinkel  and  Nemhauser  (1972),  Greenberg  (I97I),  or 
Hu  (1969).  Surveys  of  integer  programming  algorithms  have  been  presented 
by  Balinski  (1965),  Lawler  and  Wood  (1966),  and  Geoffrion  and  Marsten 
(1972).  This  last  survey  deserves  special  mention  in  that  there  is  also 


1 


l ; 


I i 
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Node  0 


Branch-and-bound  tree  structure  for  the 
general  integer  programming  problem 


a general  framework  developed  which  serves  to  both  unify  and  contrast 
the  ideas  underlying  the  three  classes  of  integer  programming  algorithms 
The  present  discussion  has  in  part  followed  the  presentation  in  the 


Geoffrion  and  Marsten  survey 


Despite  the  wide  variety  of  algorithmic  approaches  which  have  been 


proposed,  the  art  of  integer  programming  today  still  cannot  claim  the 


same  degree  of  success  as  has  been  enjoyed  in  the  field  of  linear  pro- 


gramming. Computational  surveys  of  existing  computer  codes,  such  as 
those  by  Trauth  and  Woolsey  (1969)  and  Geoffrion  and  Marsten  (1972), 
indicate  that  even  small  or  moderately-sized  integer  programming  problems 


can  sometimes  require  disproportionately  large  amounts  of  computation 


time.  Moreover,  it  has  generally  been  accepted  that,  even  with  the 


best  of  the  available  computer  codes,  solution  times  for  integer 


— — 


programming  problems  increase  exponentially  with  the  number  of  problem 


variables.  While  it  has  not  yet  been  demonstrated  that  it  is  impossible 


to  construct  an  integer  programming  algorithm  whose  solution  time  can 


be  bounded  by  a polynomial  function  of  the  number  of  variables,  none 


theless,  the  inception  of  a general-purpose  integer  programming  algorithm 


with  the  same  overall  degree  of  efficiency  as  the  simplex  method  seems 


an  eternally  elusive  goal 


By  contrast,  some  particularly  notable  successes  have  been  enjoyed 


by  special-purpose  algorithms  specifically  designed  to  treat  limited 


classes  of  specially-structured  integer  programming  problems.  See, 


for  example,  Geoffrion  and  Graves  (1973) , Healy  (1964),  Reardon  (197*0 


or  Tomlin  (1970).  The  classes  considered  are  generally  of  significant 


practical  importance,  and  often  the  work  has  been  undertaken  with  a 


particular  application  in  mind.  In  the  face  of  the  current  state  of  the 


art  of  general  integer  programming  algorithms,  and,  on  the  other  hand, 


the  results  obtained  in  applications  using  highly  specialized  algorithms 


this  latter  approach  would  seem  a most  viable  alternative.  In  fact 


these  considerations  have  served  as  the  philosophical  basis  for,  and  have 


greatly  motivated  the  present  work 


1. 3 The  Decomposition  Principle:  A Historical  Perspective 


Linear  programming  models  with  the  block  angular  structure  arise 


frequently  in  many  large-scale  applications.  In  a multidivisional 


corporation,  for  example,  the  activities  in  each  of  the  subdivisions 


are  often  quite  independent  of  the  activities  of  other  subdivisions 


If  complete  independence  holds,  of  course,  the  optimal  operation  of 


each  of  the  subdivisions  can  be  treated  as  a separate  problem  in  its 


r 
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own  right.  Most  commonly,  however,  the  subdivisions  must  compete  for 
a few  resources  (e.g.,  capital,  labor)  on  which  there  are  corporate- 
wide limitations.  This  situation  naturally  leads  to  mathematical  models 
with  the  block  angular  structure. 

As  practical  block  angular  problems  tend  to  be  rather  large  in 
size,  sometimes  involving  thousands  of  constraints  and  many  thousands 
of  variables  overall,  solution  algorithms  which  proceed  by  decomposing 
the  problem  into  its  (smaller)  subproblems  and  a single,  coordinating 
"Master  Problem"  can  be  of  great  value.  Since  the  computational  effort 
required  to  solve  linear  programming  problems  increases  approximately 
as  the  cube  of  the  number  of  rows  in  the  problem,  decomposition  algorithms 
often  provide  more  efficient  solution  procedures  for  large,  structured 
linear  programs  than  do  the  more  straightforward  linear  programming 
techniques.  Moreover,  even  with  today’s  largest  computers,  the  extreme 
size  of  many  block  angular  problems  can  exceed  available  in-core  (high 
speed)  memory  capacity.  Since  accessing  disks,  drums,  or  tapes  is  a 
much  slower  process  than  in-core  memory  retrieval,  computation  time 
can  quickly  become  excessive  for  such  problems.  By  breaking  the  problem 
into  the  smaller,  more  tractable  subproblems,  however,  decomposition 
algorithms  can  substantially  reduce  the  number  of  accesses  required  of 
external  storage  devices,  thereby  further  enhancing  computational  effi- 
ciency. 

Because  of  the  practical  importance  of  block  angular  mathematical 
programs,  and  the  inherent  advantages  of  decomposition  algorithms,  much 
attention  has  been  devoted  towards  exploiting  this  special  structure 
when  all  the  problem  variables  are  assumed  to  be  continuous.  Analysis 
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! 


began  with  the  pioneering  work  of  Dantzig  and  Wolfe  (i960),  who  considered 
the  problem  defined  by  (l)-(4),  that  is,  the  linear  programming  problem 
associated  with  (P).  Decomposition  is  achieved  by  expressing  all  feasible 
subproblem  solutions  as  convex  combinations  of  the  extreme  points  of  the 
convex  set  of  such  solutions. 


Briefly,  the  central  ideas  of  the  Dantzig-Wolfe  algorithm  are  as 


follows.  Let  F^  denote  the  set  of  feasible  solutions  to  the 


subproblem,  namely, 

F^  = {x^|b^x^  < P^',  x^  >0},  j = 1,2,  ...  , N . (11) 


We  assume  for  the  present  discussion  that  F 


(j) 


is  bounded.—  Let 


1/ 


7^ ^ (k  = 1,  2,  ...  , Ej)  denote  the  kth  extreme  point  of  F^, 


where  E.  is  the  (finite)  number  of  such  extreme  points.  Then  any 
r(j)  e j-(j)  can  expressed  as 


E. 


X(J)  = g"  W(J)7(J) 

ktl  * 


(12) 


for  some  set  of  weights  w'0',  k = 1,  2, 


, E . , such  that 
0 


w[^  = 1 and  w[^  > 0,  for  k = 1,  2, 

k=l 


Moreover,  since  any  point  x 


k - 

(d) 


’ Eo 


(15) 


which  can  be  expressed  in  this  form  must 


P(d) 


be  in  FVd  , it  is  seen  that  (12),  (13)  provide  an  equivalent  repre- 

(J) 


sentation  for  the  set  F 
Thus,  letting 
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— There  are  minor  modifications  to  the  procedure  when  F 
See  Dantzig  and  Wolfe  (i960). 


(d) 


is  unbounded. 
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= c^'  7^  , for  j - 1>  2,  ...  , N;  k - 1,  2,  ...  , , (l^) 


a(0)  £a(J)7^J),  for  j = 1,  2,  ...  , N;  k = 1,  2,  . . . , E.  , (15) 


(l)-(4)  can  be  re-written  as, 

E,  E, 


± 

(M)  maximize  2/ 
k=l 

subject  to 


E E 

(1)  (1)  -f  (2)  (; 

>,  p,  w,  + /)  p,  w, 

A k k A k k 


^M2) a 


s ■W  * i «£a>>4‘ 

l=  -L  K=  -L 


sW 


E, 

7 w*'1^ 

k^i  k 


E.. 

s *[N) 

k=l 


>0  for  j = 1,2,  ...  , N;  k = 1,2,  ...  , 


Problem  (M),  which  Dantzig  and  Wolfe  have  called  the  Master  Problem,  has 

N 

only  m + N rows,  rather  than  the  m + 2/  m-  rows  of  (P),  although 

J-l  J 

in  general  it  may  have  many  more  columns  than  (p).  This  difficulty  is 
circumvented,  however,  by  using  the  revised  simplex  method  and  generating 
the  columns  of  (m)  only  as  they  are  needed.  More  specifically,  in  pricing 
out  the  current  basic  feasible  solution  of  (M)  at  each  iteration,  the 
simplex  method  requires  that  the  column  of  (M)  with  lowest  relative  cost 


(if  negative)-  be  introduced  into  the  basis  next.  This  column,  call 
* 

it  a , is  determined  by 

* ( i ) 

m = min  { min  7?CCJ  ) , (20 ) 

1 < j < N l<k<Ej 

where  7T  is  the  current  vector  of  dual  multipliers  associated  with  the 
rows  (17)  of  (m).  The  outer  minimization  in  (20)  is  trivial,  while  the 
inner  minimization  is  accomplished  for  each  j,  using  (15),  by 


min  TOO 

1 < k < Ej  * 


min  (ttA^J  )7^.J  = min  p^J  x^  , 

1 < k < E. 

J subject  to 

B(J)x(j)  < p(3) 


..  where  p^  = ttA^.  From  the  theory  of  linear  programming,  it  is  well 


known  that  at  least  one  optimal  solution  xv 


to  the  j subproblem 


(21)  will  indeed  be  an  extreme  point  7^^  of  the  set  F^^  for  some 

k = 1,  2,  ...  , E . • 

J 

Balas  (1966)  has  presented  an  alternative  decomposition  algorithm 
for  block  angular  linear  programming  problems.  In  Balas'  work,  the  linking 


constraints  are  at  first  ignored  and  the  subproblems  solved  separately. 
Any  infeasibilities  in  the  resulting  solution  are  then  used  to  develop 
a modified  set  of  price  vectors  for  the  subproblems.  The  subproblems 
are  resolved  with  the  new  objective  functions,  and  the  procedure  con- 
tinues to  iterate  in  this  manner  until,  after  a finite  number  of  such 
iterations,  the  optimal  solution  is  obtained. 


— If  all  columns  are  found  to  have  nonnegative  relative  costs,  the 
current  solution  is  optimal. 
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Belas'  decomposition  algorithm  bears  many  similarities  conceptually 
to  the  algorithm  of  Dantzig  and  Wolfe.  Both,  for  example,  provide  a 
means  for  decentralized  planning  in  a multi-divisional  organization 
through  the  use  of  an  internal  pricing  system.  However,  while  in  Dantzig 
and  Wolfe's  procedure,  a feasible  solution  is  obtained  first  and  then 
iteratively  improved  upon  until  the  optimum  is  achieved,  Balas'  algorithm 
proceeds  by  obtaining  an  "optimal"  (infeasible)  solution  first,  then 
iteratively  reducing  the  infeasibility  of  the  generated  solutions  while 
maintaining  optimality. 

Others  who  have  considered  the  problem  of  decomposing  structured 
linear  programs  are  Bennett  (19 66),  Hartman  and  Lasdon  (1970),  Ritter 
(1967),  and  Rosen  (1964).  To  date,  however,  little  consideration  has 
been  given  to  block  angular  models  in  which  the  decision  variables  are 
required  to  take  on  only  integer  values.  Yet,  especially  in  integer 
programming  problems,  where  computation  time  may  increase  exponentially 
with  the  number  of  problem  variables,  it  appears  that  substantial  savings 
can  be  achieved  by  solving  a judiciously  chosen  sequence  of  the  smaller 
subproblems,  rather  than  attacking  the  problem  as  a whole.  For  example, 
it  should  be  possible  to  solve  ten  ten-variable  subproblems  in  much  less 
computer  time  than  would  be  required  to  solve  one  one-hundred  variable 
problem.  Moreover,  as  with  its  linear  programming  counterpart,  an 
algorithm  for  solving  large,  block  angular  integer  programs  which  treated 
only  one  subproblem  at  a time  could  render  solvable  problems  whose  overall 
size  would  otherwise  result  in  prohibitive  in-core  storage  requirements. 
These  considerations  have  motivated  the  present  work. 

At  this  point,  previous  and  related  results  in  the  area  of  decomposing 


I 


integer  programs  deserve  some  mention.  Schrage  (1973)  was  apparently 
the  first  to  consider  the  advantages  of  a decomposition  algorithm  for 
specially  structured  integer  programming  problems.  Schrage' s paper  was 
primarily  concerned  with  problems  in  which  the  constraint  matrix  possesses 
a dual  angular  structure,  that  is,  where  the  subproblems  are  tied  to- 
gether by  a set  of  linking  columns  rather  than  linking  constraints. 

In  a linear  programming  sense,  this  is  the  dual  structure  to  the  one 
considered  here. 

Reardon  (197*0  showed  how  certain  capital  budgeting  problems  could 
be  formulated  with  the  dual  angular  structure,  and,  developing  and 
refining  Schrage *s  ideas,  designed  a decomposition  algorithm  to  treat 
problems  with  this  structure.  Schrage 's  suggestion  was  that,  in  using 
a partial  enumeration  solution  procedure  for  dual  angular  integer  pro- 
grams, one  should  give  priority  to  fixing  the  values  of  the  linking 
variables  first.  Once  these  columns  have  been  fixed,  the  problem  de- 
composes of  its  own  accord  into  independent  subproblems.  Reardon's 
idea,  then,  was  to  separate  the  problem  into  subproblems  from  the  start, 
thereby  relaxing  the  restriction  that  the  linking  variables  (called 
"first  stage"  variables)  must  take  on  the  same  values  in  each  subproblem. 


This  restriction  is  implicitly  re-imposed  by  stipulating  that  each  of 
the  subproblems  must  have  identical  first-stage  search  trees.  In  compu- 
tational tests  of  the  algorithm,  Reardon  obtained  an  approximately  linear 
increase  in  solution  time  with  problem  size,  a vast  improvement  over 
the  roughly  exponential  growth  observed  with  a non-decomposition  approach! 

It  is  natural  to  consider  using  Lagrangean  relaxation  as  a means 
of  decomposing  block  angular  integer  programs.  Such  an  approach  would 


be  analogous  to  Balas’  infeasibility  pricing  algorithm  for  decomposing 
block  angular  linear  programming  problems.  Geoffrion  (197*0  discusses 
the  uses  of  Lagrangean  relaxation  in  integer  programming.  The  central 
idea  is  to  simplify  an  otherwise  difficult  problem  by  ising  a suitably 
chosen  set  of  multipliers  to  take  any  "complicating"  constraints  (in 
the  present  context,  these  would  be  the  linking  constraints)  up  into 
the  objective  function.  Thus,  using  the  m-vector  of  multipliers 
X > 0,  (P)  would  be  transformed  to, 


maximize 


subject  to 


j=l  j=l 


b(»)x(»)  < p(H) 


xVtW  < 0,  for  j = 1,  2,  ...  , N 

x1^  integer,  for  j = 1,  2,  ...  , N . 


By  choosing  specific  values  \ for  the  multipliers,  (22)-(25)  then 
immediately  decomposes  into  the  N subproblems: 

maximize  (c^  - \*A^)x^  , 


subject  to 


c<j)  > 0,  integer  , 


for  j = 1,  2,  ...  , N. 


r 


I 1 


Lasdon  (1973)  has  considered  an  approach  along  these  lines  in  a 

1/ 


production  scheduling  application.-  The  difficulty  with  such  an  approach, 
as  Lasdon  points  out,  is  that  in  general,  due  to  the  non-convexity  of 
the  feasible  region,  there  is  no  guarantee  that  there  exists  a choice 
of  values  for  the  multipliers  X.  that  leads  to  an  optimal  solution 
to  (P).  Worse,  one  cannot  in  general  even  be  assured  of  finding  a feasible 
solution  - that  is,  one  satisfying  the  linking  constraints  as  well  as 
the  subproblem  constraints  - for  (P)  in  this  way.  In  view  of  Balas* 
results  with  block  angular  linear  programs,  this  state  of  affairs  is 
somewhat  disappointing.  However,  Lagrangean  relaxation  may  still  be 
useful  as  a heuristic  approach  in  integer  programs  where  it  is  not 
strictly  required  that  all  of  the  constraints  be  met. 


1.4  Overview 


In  the  remaining  chapters,  then,  an  exact  algorithm  for  the  decom- 
position of  block  angular  integer  programs  is  developed.  A conceptual 
outline  of  the  algorithm  is  presented  in  Chapter  2.  Decomposition  occurs 
through  resource  allocation,  and  a branch-and-bound  search  for  the  optimal 
allocation  of  linking  resources  to  subproblems  is  established. 

Details  of  the  algorithm  are  discussed  in  Chapters  3-5.  Specifically, 
Chapter  3 deals  with  the  question  of  how  the  branching  is  to  be  done, 
while  Chapters  4 and  5 develop  procedures  for  computing  bounds  at  each 
node  in  the  search  tree.  In  Chapter  4,  the  case  in  which  (P)  has  only 
a single  linking  constraint  is  considered.  In  modeling  the  operation 
of  a multi-divisional  organization,  such  a constraint  might  represent 
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— Lasdon' s paper,  as  well  as  Geoffrion's,  also  contains  an  excellent 
discussion  of  the  concepts  relating  to  generalized  Lagrange  multipliers. 
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the  overall  corporate  budgeting  limitation  to  which  all  of  the  subdivisions 
(subproblems)  are  subject.  The  simplifications  that  result  in  this  case 
give  rise  to  a specially  structured  master  problem,  and  an  efficient 
solution  algorithm  which  exploits  this  structure  is  developed.  The 
problem  of  computing  bounds  in  the  presence  of  more  than  one  linking 
constraint  is  addressed  in  Chapter  5» 

Computational  results  obtained  with  a Fortran  code  of  the  decompo- 
sition algorithm  on  an  IBM  370/l68  are  presented  in  Chapter  6.  Finally, 
in  Chapter  7>  we  summarize  our  results  and  discuss  some  suggestions  for 
areas  of  future  research. 

Some  of  the  results  of  Chapter  4 are  generalized  in  Kochman  (1976), 
where  a class  of  nonlinear  integer  programming  problems,  of  which  the 
master  problem  developed  in  Chapter  4 is  a member,  is  introduced.  A 


general  solution  procedure  for  problems  in  this  class  is  discussed,  and 
two  illustrative  examples  are  presented. 


18 


. 


CHAPTER  2 


RESOURCE  DECOMPOSITION:  A CONCEPTUAL  OUTLINE 


The  algorithms  of  Dantzig  and  Wolfe  (i960)  and  Balas  (1966)  dis- 
cussed in  Chapter  1 both  utilize  pricing  mechanisms  to  achieve  the 
decomposition  of  block  angular  linear  programs.  Lasdon’s  generalized 
Lagrange  multiplier  approach  to  the  integer  programming  problem  might 
also  fall  into  the  category  of  "price  decomposition"  algorithms.  The 
difficulty  with  such  approaches  in  an  integer  programming  context,  however, 
is  that,  in  sharp  contrast  to  the  linear  programming  case,  there  does 
not  exist  any  comparably  well-defined  and  well-behaved  system  of  shadow 
prices.  Consequently,  an  alternative  approach  is  considered  here,  and 
the  resulting  algorithm  proceeds  through  what  might  be  called  resource 
decomposition.  In  this  chapter,  we  present  a conceptual  basis  for  the 
decomposition  algorithm. 


2. 1 Resource  Decomposition 

Consider  again  the  problem  (p) 

(P)  maximize  ]>/ 

J=1 

subject  to 

I A<a>*<a> 

j-i 

B(j)x(j) 

X(J) 
x<J> 


introduced  in  Chapter  1: 

(1) 


< b 

(2) 

< P(j), 

for 

J = If 

2,  ... 

, N 

(3) 

> 0 , 

for 

•V 

1 — 1 

II 

T) 

2 , ... 

, N 

(4) 

integer, 

for 

J = 1/ 

2,  ... 

, N . 

(5) 
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Let  x'J  , 1 < j < N,  denote  an  optimal  solution  to  (P),  and,  corres- 


pondingly, define  the  m-vectors  bVJ  by 


;(d)  = A(J)*(d) 


j-1,  2,  ...  , N 


Conceptually,  the  linking  constraints  (2)  can  be  viewed  as  repre- 
senting common  resources  which  the  subproblems  must  share.  Under  this 

A / . \ 

interpretation,  the  b'1^  in  (6)  are  seen  to  be  in  some  sense  an  optimal 
allocation  of  these  resources  to  the  subproblems.  Clearly,  were  the 
values  bVJ  , j = 1,  2,  ...  , N,  known  beforehand,  (P)  could  be  decom- 

A / . \ 

posed  immediately  and  the  optimal  solution  , j = 1,  2,  ...  , N, 

obtained  simply  by  solving  the  N subproblems, 

(S.)  maximize  C(3)X(J)  ^ 

J 


subject  to 


B(j)x(J)  < p(J) 

x^  > 0,  integer  , 


for  j = 1,  2,  ...  , N.  These  subproblems  (S.),  j = 1,  2,  ...  , N, 

J 

could  be  solved  by  any  of  the  various  standard  integer  programming  algor- 
ithms discussed  in  Chapter  1. 

''(I) 

Unfortunately,  in  general  an  optimal  allocation  h'u  , 
j = 1,  2,  ...  , N,  is  not  known  until  after  (p)  has  been  solved.  How- 
ever, in  view  of  the  reduction  which  results,  it  appears  that  it  may  be 

*•(  -i ) 

profitable  to  "guess"  at  values  for  the  b'°  , j = 1,  2,  ...  , N,  or 
rather,  to  devise  a systematic  means  of  determining  a sequence  of  such 
guesses  which  leads  to  an  optimal  allocation  in  a finite  number  of  steps. 
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j - 1,  2 f . . . 


To  this  end,  instead  of  considering  the  bv  , j = 1,  2,  ...  , N,  as 
fixed  vectors,  we  introduce  into  the  problem  the  additional  allocation 


f i ) T 

variables  bVd'  = (b^,  b2j , . • . , b ) , j = 1,  2,  ...  , N,  where 


each  b„  has  the  interpretation 


.th 


b = amount  of  i linking  resource  allocated  to 
■**  J 


. th 


j subproblem,  1 < i < m,  1 < j < N . 


The  resulting  (equivalent)  formulation  of  the  original  problem  (P) 


is 


• • (1)  (1)  (2)  (2)  (N)  (N) 

maximize  cv  xv  + cv  xv  +•••+  c'  'x'  ' , 


subject  to 

b^  + b^  +•••+  b^  < b 

A^x^-b^  <0  ^ 

B(l)x(1>  < p*1* 

A<2>x<2)-b<2>  <0 

B^2^x^2^  < 

A(N)x(N)_b(N)  £ Q 

b(N)x(N)  < p(H) 


> 0,  integer,  for  j = 1,  2,  ...  , N . 


The  transformed  problem  (P*)  is  itself  a block  angular  integer  program, 
in  which  the  linking  constraints  are  now  of  the  form  (8).  These  con- 
straints on  the  b^,  j = 1,  2,  ...  , N,  are  necessary  to  insure  that 


* 


the  linking  resources  are  not  over-allocated,  and  are  implied  by  the 
inequalities  (2)  in  (p). 

Although  they  may  be  required  to  be  nonnegative  in  certain  appli- 
cations (e.g.,  when  they  actually  represent  resource  allocations),  the 
allocation  variables  b^,  j = 1,  2,  ...  , N,  are  not,  in  general, 
restricted  in  sign.  We  shall  assume  throughout,  however,  that  each  of 
the  matrices  A ^ , j = 1,  2,  ...  , N,  has  all  integer  entries.  This 
assumption  implies  that  any  feasible  integer  solution  to  the  j^*1 

subproblem  of  (P)  can  use  only  integeral  amounts  of  the  linking  resources. 
Consequently,  the  search  for  an  optimal  allocation  of  these  resources 
to  the  subproblems  can  be  restricted  to  integer  values  of  the  allocation 
variables  b„.— ■ 

Reordering  the  variables  in  (P'),  and  writing  the  problem  in  block 
form  leads  to  the  representation. 


(P") 


maximize  |0  b 
subject  to 


,Tk(l)|0Tb(2)L..Cyi<T 


-I 


-I 


GD 


(u> 


< b (12) 


< 0 

<PW 

< 0 
< 


> (13) 


TnF 


,(N) 


< 0 


< ^ 


(N) 
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— Note  that  the  assumption  of  integrality  of  the  entries  in  each  A'  , 


U) 
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MHMM 


> 0,  integer,  for  j = 1,  2,  ...  , N 
integer,  f'r'y'  ■*  - 1 5 w 


for  j = 1,  2,  ...  , N . 


In  this  form,  (P’)  takes  on  the  dual  angular  structure  considered  by- 
Reardon  ( 1974 ) , with  the  allocation  variables  forming  the  linking  columns. 
In  this  sense,  the  algorithm  developed  here  is  a specialized  procedure 
for  decomposing  dual  angular  integer  programs  in  which  the  linking 
columns  possess  the  special  structure  exhibited  in  (P").  The  out- 
standing feature  of  this  structure  is  that  each  of  the  linking  variables 
b„  has  a non-zero  coefficient  in  exactly  one  subproblem.  Whereas  in 
the  general  dual  angular  problem  all  linking  columns  must  be  assigned 
fixed  values  before  decomposition  occurs  (at  which  point  the  decompo- 
sition is  total),  in  (P")  partial  decomposition  occurs  whenever  all  the 
allocation  variables  b^  associated  with  one  given  subproblem  are 
fixed.  Once  values  b^  = b^  (possibly  nonoptimal)  have  been 

specified,  the  subproblem  (s.)  can  be  solved  immediately,  independently 

J 

of  the  others,  and  the  information  obtained  used  to  improve  the  allo- 
cations in  the  remaining  subproblems.  This  point  is  clarified  in 
Chapter  3. 


2.2  A Branch -and -Bound  Search  for  an  Optimal  Allocation 


Using  the  corcepts  of  resource  decomposition  described  in  the  pre- 
ceding section,  the  block  angular  integer  program  (P)  is  transformed  into 

. . * 

the  N "separate"  subproblems  (S^)  by  specifying  values  b'J'  for 


j = 1,  2,  . . . , N, is  sufficient  for  this  conclusion,  but  not  necessary. 
It  may  happen  in  certain  applications,  for  example,  that  the  nature  of 
the  linking  resources  is  such  that  they  can  be  meaningfully  divided  among 
the  subproblems  only  in  integral  amounts. 


23 


the  allocation  variables  b 


j = 1,  2,  ...  , N.  The  problem  of 

t \* 

finding  an  optimal  solution  x^  , j = 1,2,...,N,  for  (p)  thus  becomes 
that  of  determining  an  optimal  allocation  of  linking  resources  to  sub- 
problems. The  subproblems  are  tied  together,  and  the  possible  choices 
of  values  b^  = b^  , j = 1,  2,  . . . , N,  are  restricted  by  the 
inequalities  (8).  Moreover,  under  the  assumption  of  integrality  in 
the  matrices  A^,  j = 1,  2,  ...  , N,  only  integer  values  for  the 
allocation  variables  need  be  considered. 

In  many  practical  situations,  previous  experience  with  the  problem 

may  provide  a good  initial  estimate  for  an  optimal  allocation.  The 

difficulty,  of  course,  is  that  although  the  subproblem  optimal  solutions 
* * 

corresponding  to  a given  allocation  b^  , j = 1,  2,  ...  , N, 
may  constitute  a very  good  - perhaps  even  optimal  - solution  to  (P), 
there  is  no  guarantee  that  these  solutions  will  be  optimal,  nor  even 
any  simple  means  of  determining  their  optimality  or  nonoptimality. 
Consequently,  it  will  generally  be  necessary  to  examine  a sequence  of 
estimates  for  the  optimal  allocation.  Obviously,  it  is  desirable  to 
design  this  sequence  in  such  a manner  that  only  a "reasonable"  number 
of  allocations  must  be  examined  in  all. 

The  procedure  developed  here  utilizes  a branch -end-bound  type  search 
strategy  to  locate  an  optimal  allocation,  and  is  similar  in  concept  to 
that  presented  in  Section  1.2  in  the  context  of  the  general  integer 
programming  problem.  In  the  present  context,  the  feasible  set  Fq 
to  be  searched  is  defined  by 

FQ  i C(b^1),...,b^N^)|  ^ 1 b>  and  bt1  S 5 b b integer  Vi,j} 


where  b 


lower  and  upper  bounds,  respectively,  on  the  allocation  variable  b 


1 < i < m,  1 < j < N,  and  b is  the  vector  of  linking  constraint 


right-hand  sides  in  (2).  Procedures  for  computing  the  initial  values 


The  basic  structure  of  the  search  tree  in  this  case  is  shown  in 


To  begin  the  search,  an  allocation  b 


Figure 


N,  is  chosen  from  the  set  F0  and  substituted  into  the 


subproblems  (s.).  Each  of  the  subproblems  is  solved  in  turn  to  obtain 


, If  ("optimal"  relative 


its  integer  optimum  x 


If  all  the  subproblems  are  feasible  under 


to  the  allocation  b 


, N,  the  corresponding  objective 


the  allocation  b 


immediately  provides  a lower  bound  for  the 


optimal  objective  value 


Node  0 


Node  2 


Node  1 


Figure  1:  Search  tree  structure  for  locating  an  optimal  allocation 


,(J)’ 


At  this  point  it  is  unknown  whether  xw/  , j = 1,  2,  ...  , N, 
is  optimal  for  (P)  in  an  overall  sense.  We  therefore  seek  an  improved 


solution,  or,  by  failing  to  find  one,  verification  of  the  optimality  of 
* . . * 

x^'  , j = 1,  2,  ...  , N.  Assuming,  then,  that  x'J  , j = 1,  2,  ...  , N, 


is  not  optimal  for  (P),  at  least  one  of  the  allocations  b„  must  be 


nonoptimal.  Hence,  one  variable,  b.  . say,  is  chosen  as  the  branching 


Vo 


variable,  and  FQ  is  partitioned  as  indicated  in  Figure  1.  On  one  branch, 


a new  lower  bound  on  b.  . , say  b’  . (where  b.'  . > b.  . ) , is 

Vo  Vo  “Vo  Vo 

specified.  On  the  other  branch,  the  upper  bound  on  b..  . is  revised 

t 


to  b'  . (where  b.  . < b,  . ).  Thus,  the  sets  F,,  F0  are  defined 

ij„  V„  - V«  1 2 

by 


o o 


o o 


o o 


Fi  5 


• ■ b(1,>)lbi i Sh  j ’ 

O^O  oJo 


and 


F2  - 


,bW)|b. 


> b\.  4 } 


Vo  ~ Vo 


(17) 

(18) 


In  keeping  with  the  "divide  and  conquer"  strategy  of  branch-and-bound 


search,  the  new  bounds  b!  . , b]  . must  be  chosen  to  ensure  that  an 

' h i ' -i  -i 

1/ 


“Vo  Vo 


optimal  allocation  lies  in  the  set  F^\J  Fg,  while  F^Pl  Fg  = ' As 

before,  one  of  the  two  sets,  say  Fg,  is  stored  on  a list  for  later 


investigation.  The  other  set,  F^,  is  examined  next. 


The  examination  of  a given  subset  F.  begins  with  the  computation 

J 


of  an  upper  bound  z on  the  optimal  objective  value  in  (P)  attainable 


by  any  allocation  (b^,  ...  , b^)  e F..  If  z < z*  (the  current 

J 


incumbent  objective  value),  Fj  is  fathomed  and  a new  problem  is  taken 


V 


— In  particular,  we  must  have  bf  > b.' 


^TlJn 


The  branching  process, 


~o'J  O 0°  o 

including  the  selection  of  these  revised  bounds,  is  discussed  in  Chapter  3. 
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from  the  list  instead.  If  z > z , however,  may  contain  an  allo- 

cation leading  to  an  improved  objective  value  in  (p).  In  this  case, 

Cl)'  (N)« 

a promising  new  allocation  (b^  , ...  , bv  ) is  chosen  from  Fj 

and  substituted  into  the  subproblems.  From  this  point,  the  procedure 

for  F.  is  the  same  as  that  described  above  for  FQ,  with  the  exception 

(i) ' 

that  the  new  solution  x , j = 1,  2,  . . . , N,  and  corresponding 

N / . \ / . \ , 

objective  value  z'  = £ c'^'x'J  is  retained  as  the  (new)  incumbent 

j=l 

, * 

solution  only  if  z > z . 

We  summarize  these  remarks  with  a conceptual  outline  of  the  algor- 
ithmic procedure: 


Rudimentary  Branch-and-Bound  Algorithm  (RBBA) 


Step  1.  Initialize  the  list  to  contain  only  the  original  set  FQ. 
* 

Set  z = -<». 


Step  2.  If  the  list  is  empty,  stop: 

* / V 

If  z = -oo,  (p)  is  infeasible. 

* 

Otherwise,  the  incumbent  is  optimal  and  z is  the  maximal 
objective  value. 

If  the  list  is  not  empty,  select  one  of  the  sets  F.  to  be 

0 

searched  next,  and  remove  F.  from  the  list. 

3 

Step  5.  (The  bounding  step.)  Compute  an  upper  bound  U on  the  maximal 


objective  value  attainable  by  any  allocation  in  F.. 

J 

If  U < z , go  to  Step  2.  (F.  is  fathomed.) 

Otherwise,  select  a promising  allocation  (b^  ,...,b^  ) e Fj 
and  go  to  Step  4. 


Step  4.  Using  the  allocation  , solve  the  j subproblem  (S^) 


to  obtain  the  integer  optimum  x 
j = 1,  2,  . » • , N» 


(.j) 


(if  it  exists). 


(i)  If  any  subproblem  is  infeasible,  or  if  the  current  allo- 


.(1) 


cation  (bv‘uy  , , b^  ) can  otherwise  be  recognized 

as  nonoptimal,  go  (immediately)  to  Step  5-  (Don’t  solve 
the  remaining  subproblems.) 

(ii)  If  all  subproblems  (S.)  are  feasible,  and  ( S k)  is 
unbounded  for  seme  1 < k < N (i.e.,  (S^)  ^ias  no 

finite  optimal  solutions),  stop.  (Problem  (p)  is  un- 

(l)*  (n)* 

bounded  and  the  current  allocation  (bv  ,...,b  ) 

is  clearly  optimal. ) 

( in)  if  all  subproblems  (S.)  have  finite  optimal  solutions 
* ^ 

x^}  , j = 1,  2,  ...  , N,  and  if  the  corresponding 


N fi]  n)* 

objective  value  c'  * 


> z , reset 


' x 


and  install  x 
N 


N 

a = £ c 

j=l 

as  the  new  incumbent,  (if  c 

j=l 

current  incumbent  is  retained.) 

Go  to  Step  5* 


(o) 


, j — 1,2,... ,N, 
* 


UW  < z*,  the 


Step  5.  (The  branching  step.)  Choose  a branching  variable  b.  . and 
oJo 

partition  the  set  F^  as  discussed  above:  e.g., 

(i)  In  the  first  subset,  F . , reset  b = b*  . 

J1  “Vo  Vo 

(ii)  In  the  second  subset,  F.  , reset  b.  . = b*  . 

J2  Vo  Vo 

Add  F.  to  the  list. 

J1 

Then  go  to  Step  3,  where  now  F,  takes  the  place  of  F.. 
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The  description  of  the  branch-and-bound  algorithm  above  is  far  from 

complete.  Procedures  for  computing  the  objective  function  bounds  required 

at  Step  3 are  the  subjects  of  Chapters  4 and  5.  It  will  be  seen  there 

that  the  problem  of  locating  a "promising"  new  allocation  in  an  unfathomed 

set  F.  in  Step  3 is  closely  connected  with  the  bounding  procedures. 

J 

In  fact,  the  allocation  selected  for  use  in  Step  4 will  be  the  one  in 


F.  which  gives  the  greatest  upper  bound  on  the  overall  objective  function 
«] 

value  in  (P). 


In  Step  5>  the  two  points  requiring  further  specification  are  deciding 

which  allocation  variable  should  be  selected  as  the  branching  variable, 

and,  once  chosen,  specifying  the  bounds  b!  . , b!  . which  define  the 

1oJo  oJo 

partitions  F.  , F.  . These  are  discussed  in  the  next  chapter. 

J1  °2 

Finally,  some  decision  rule  is  needed  in  Step  2 regarding  the  selection 

of  the  subset  F.  from  the  list.  In  the  algorithm  developed  here,  the 
J 

last-in-first-out  (LIFO)  rule  is  used.  Under  the  LIFO  strategy,  the 

last  set  F.  added  to  the  list  in  Step  5 is  always  .the  first  one  to 
J 

be  chosen  for  examination  next  in  Step  2.  This  rule  facilitates  pro- 
gramming the  algorithm,  and,  more  importantly,  can  increase  algorithmic 
efficiency  by  reducing  the  computational  effort  required  in  reoptimization. 
For  these  reasons,  use  of  the  LIFO  strategy  is  a standard  practice  in 
many  branch-and-bound  type  search  procedures. 

The  advantages  of  the  decomposition  procedure  become  apparent  in 
Step  4.  For  the  reasons  discussed  in  Chapter  1,  the  most  significant 
feature  of  the  algorithm  is  the  fact  that  only  the  subproblems  (S^.) 
ever  need  be  solved  explicitly.  Moreover,  it  will  be  seen  that  the 


subproblems  may  be  solved  by  any  linear -programming  based  method.  This 
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is  advantageous  if  the  subproblems  themselves  possess  structures  that 


can  be  efficiently  exploited  by  specialized  solution  procedures.  Finally, 


it  will  usually  be  possible  to  recognize  that  an  allocation  b 


, N,  is  nonoptimal  without  solving  all  of  the  subproblems 


When  this  situation  occurs,  the  computations  in  Step  k are  terminated 


and  we  proceed  immediately  to  Step  5 


2.3  Computing  Bounds  on  the  Allocation  Variables 


For  most  problems,  the  initial  specification  of  the  bounds  b 


(1  < i < m,  l<j<N)  defining  the  set  Fn  is  not  crucial,  provided 


of  course  that  the  intervals 


to  ensure  that  an  optimal  allocation  is  included.  In  this  section  we 


present  some  simple  procedures  for  computing  valid  initial  bounds  on 


the  allocation  variables 


Suppose  first  that  we  have  been  given  upper  and  lower  bounds  U 


, respectively,  on  the  vector  of  decision  variables  x 


sub problem 


in  (19)  often  can  be  readily  inferred  from  the 


The  bounds  L 


functional  constraints,  and,  inasmuch  as  many  practical  integer  programming 


algorithms  require  the  specification  of  such  bounds  prior  to  solution 


of  the  problem,  the  assumption  is  not  a very  restrictive  one 


Define  the  index  sets  P 


N,  where  A 


the  entry  in  the  ibb  row,  k^1  column  of  the  matrix  of  linking 

constraint  coefficients  for  the  subproblem.  Then  for  1 < i < m, 

1 < d < N, 


i - b * s 


“ ik  k , u ik  k . % 

k=l  keP. . keN. . 

id  ij 


> £ Alk)Lkj)  + 2 Aik)ukj)  > by  (19)  and  ^2o) 


kePij 


keN.  . 
10 


ik  k 


Hence, 

^ £ Aik>LkJ>  + „ B 4k,UkJ)’  1 < i < m,  1 < j < » , (21) 

kcPy  kkBy 

represents  a valid  lower  bound  on  the  allocation  variable  b^. 
Similarly,  it  is  easy  to  see  that 


V _ Tk  A ( o'  ).t(  o' ) , <c\  ,(d)T(d) 

bii  = U Aik  uv  + U A-k  Lk  , 

1:1  keP. . K * keN.  . k K 

id  10 


1 < i < m,  1 < d < N , (22) 


defines  a valid  upper  bound  for  b. ..  In  (21),  (22),  if  either  of  the 

* J 

sets  ^-s  ernPty>  the  corresponding  sum  is  taken  to  be  zero. 

Both  the  bounds  (21),  (22)  are  valid  in  the  sense  that  the  bounds 

i/d),  on  the  vector  of  decision  variables  x^  imply  that  the 

subproblem  must  "use"  at  least  units  of  the  ibb  linking 

resource,  and  cannot  possibly  use  more  than  b„  units.  Thus,  there 

must  exist  an  optimal  allocation  of  linking  resources  to  subproblems 

with  b„  < b„  < b^j  for  all  i = 1,  2,  ...  , m,  and  j = 1,  2,  ...  , 

Having  already  computed  the  lower  bounds  b. . from  (21),  the  upper 

* J 

bounds  b_  in  (22)  can  possibly  be  tightened,  using  (8),  since 
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£ >u  s h =>  h3  V 


< b . - Y)  b.. 
- 1 -lk 


Thus, 


b!  . = min(b. . , b. 
ij  ij  i 


i-i<- 


gives  at  least  as  tight  an  upper  bound  on  b. . as  (22)  alone. 

There  are  three  special  cases  of  (21),  (22)  which  deserve  further 
comment  due  to  the  frequency  with  which  they  arise.  Firstly,  if,  as 
will  usually  be  the  case,  we  have  l/^;  = 0 for  j = 1,  2,  ...  , N 
(nonnegativity),  (21),  (22)  reduce  to 

iu  - 2 sik)ui3)>  — - „ 2 4k>uk3)'  i < i < «,  1 5 )< » ■ 


keP.  . 
ij 


Moreover,  in  many  practical  problems  the  decision  variables  are 

restricted  to  take  on  only  the  values  0 or  1.  In  this  case,  (24)  simpli- 
fies even  further  to 


ij  = D A^},  l<i<m,  l<o<N.  (25) 

kePij 


Finally,  in  many  applications  (e.g.,  in  capital  budgeting  problems)  all 

the  constraint  coefficients  are  nonnegative.  From  (24),  it  is  clear 

that  if  fLj  = 0 for  some  j and  1 < i < m (i.e.,  > 0),  and 

there  are  nonnegativity  restrictions  on  the  (i/^  = 0),  then 

b. . = 0 for  1 < i < m. 

-ij  - - 


So  far  we  have  considered  only  the  bounds  on  the  decision  variables, 
and,  to  some  extent,  the  implications  of  the  linking  constraints  (8) 
in  computing  upper  and  lower  bounds  on  the  allocation  variables.  Tighter 
bounds  than  those  given  by  (21)  or  (22)  may  be  obtained  (at  greater 
computational  expense,  of  course)  by  using  the  subproblem  constraints 
(3)  as  well.  For  1 < i < m and  1 < j < N,  consider  the  problem, 


maximize 
subject  to 


2 A i 

k=l  1 


,(J) 

Lk  * 

(26) 

;(j)  < p(j) 

(27) 

< x^  < 

(28) 

integer  . 

(2  9) 

By  the  same  reasoning  as  before,  the  optimal  solution  x^J  to  (26)- 

(29)  provides  a valid  upper  bound  on  b. . by 

3-0 


b * ^ a! 
t t u ik  k 


Similarly,  if  the  objective  function  (26)  is  minimized  in  (26)-(29),  the 

^ / . \ 

resulting  optimal  solution  x'J^  provides  a lower  bound  on  b„  by 


- £ * 


ik  xk 


While  the  bounds  b. .,  b. . given  in  (3 0),  (31)  will  generally  be 
~”3.o  3-0 

much  tighter  than  those  provided  by  (21),  (22),  the  extra  computational 
effort  required  can  be  considerable,  since  it  involves  solving  2mN 
integer  programs.  The  work  required  can  be  mitigated  to  some  extent 
if  an  enumerative  algorithm  is  used.  In  particular,  note  that  for  fixed 
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j the  feasible  region  defined  by  (27) -(29)  is  the  same  for  all  i,  so 
feasible  solutions  found  in  the  course  of  solving  (26)-(29)  for  one  i 
can  be  used  as  initial  incumbents  in  solving  (26)-(29)  for  different  i. 
Nonetheless,  for  most  problems  it  is  doubtful  that  the  work  expended 
to  generate  the  bounds  (30),  (31)  will  prove  worthwhile.  A more  tract- 
able alternative  might  be  to  drop  the  integer  restrictions  (29)  and 
solve  the  linear  program  (26)-(28)  instead.  In  this  case,  the  upper 

and  lower  bounds  b. b. . are  given,  respectively,  by  the  greatest 

1 J 

integer  not  exceeding  the  maximal  objective  value  obtained  in  (26)-(28), 
and  the  least  integer  not  less  than  the  minimal  objective  value. 

A further  relaxation  of  (26)-(28)  which  may  be  useful  can  be  obtained 
by  taking  a weighted  nonnegative  sum  of  the  constraints  (27)  to  transform 
(26)-(28)  into  a knapsack  problem: 


maximize  l j / . \ \ 

...  S A * ' 

minimize  k=l 


subject  to 


\.B^)x^  < 
l(j)  < x(j-  < u(j) 


Here,  X > 0 i an  m. -vector  of  weights  which  may  be  chosen  in  any 

J 

reasonable  manner,  and  we  shall  not  elaborate  on  this  point.  (The  choice 


X,  =1,  1 < k < m.  - in  which  case  the  functional  constraint  in  problem 

K - — j 

(32)  is  simply  the  sum  of  the  constraints  (27)  - will  usually  suffice.) 
Since  linear  programming  knapsacl'  croblems  can  be  solved  almost  by 


inspection,—  the  bounds  b^ , b_  obtained  from  (32)  require  little 

more  computational  effort  than  those  provided  by  (21),  (22),  and  will 

generally  be  significantly  tighter. 

We  conclude  this  section  with  a word  of  caution  concerning  one 

invalid  procedure  for  computing  upper  bounds  b.  „.  on  the  allocation 

r J 

variables.  Consider  the  problem, 

maximize  c(d)x(j) 


subject  to 


x^  > 0,  integer  , 


for  j = 1,  2,  ...  , N.  Problem  (33)  is  the  relaxation  of  (s.)  obtained 

* J 

by  assigning  arbitrarily  large  values  to  b'^  , or,  equivalently,  by 

dropping  the  linking  constraints  entirely.  Denoting  the  (finite)  optimal 

solution  (if  one  exists)  to  (33)  by  x''^,  it  is  tempting  to  take 

b^  = as  providing,  simultaneously,  upper  bounds  on  b.  . 

* J 

for  all  i = 1,  2,  ...  , m.  The  reasoning  is  that  given  (in  effect) 

"th 

infinite  amounts  of  the  linking  resources,  the  j subproblem  uses 
only  A^x^  units  of  these  resources  in  an  optimal  solution.  Hence, 
there  must  exist  an  optimal  allocation  b'J'  , j = 1,  2,  ...  , N,  of 
the  (finite)  vector  of  linking  resources  b,  with  b^  < A^x^ 
for  each  j = 1,  2,  ...  , N. 


Unfortunately,  this  line  of  reasoning  is  erroneous,  and  it  is  easy 
to  construct  counter  examples.  The  difficulty  arises  from  what  might 


— The  solution  of  bounded- variable  linear  programming  knapsack  problems 
is  discussed  in  Chapter  4. 


be  called  a substitution  effect  among  the  linking  resources.  Thus, 
n . 


while  only  Aik^xk^  units  the  ith  linking 


k=l 


resource  are  used 


when  unlimited  amounts  of  all  m linking  resources  are  available,  an 

n. 


allocation  of  b^  < £)  Aik^xk^  f°r  some  1 < £ < m can  cause 


k=l 


increased  consumption  of  the  other  resources  in  the  corresponding  optimal 
.th 


solution  to  the  3 subproblem.  In  fact,  the  substitution  of  other 
resources  as  an  adjustment  to  the  decreased  availability  of  a given 
scarce  resource  is  a common  phenomenon  in  mathematical  programming 
problems . 


Of  course,  when  (P)  has  only  a single  linking  constraint  the  sub- 


stitution effect  is  eliminated.  In  this  case,  the  upper  bound  b 


di) 


^(j)x(j)  obtained  from  (33)  is  indeed  valid. 


CHAPTER  3 


BRANCHING  IN  THE  RUDIMENTARY  BRANCH-AND- BOUND  ALGORITHM 


The  branching  step  (Step  5 ) in  the  Rudimentary  Branch-and-Bound 
Algorithm  (RBBA)  presented  in  Chapter  2 is  incomplete  insofar  as  no 


decision  rules  have  been  given  to  guide  the  selection  of  the  branching 


or  the  specification  of  the  revised  bounds  associated 


variable  b 


with  the  partitioning  process.  Before  addressing  these  issues,  however, 


it  will  be  useful  to  introduce  some  preliminary  concepts  and  notation 


Preliminaries 


Definition:  An  allocation  b 


given  by  equation  (2.16) 


Note  that  the  feasibility  of  an  allocation 


without  regard  to  whether 


defined  in  terms  of  membership  in  the  set  F 


the  subproblems  (s.)  are  feasible  under  (b 


Next,  let  v(S.|bvu  ) denote  the  maximal  objective  value  in  the 

J 

j+jh  subproblem  (S  ) when  the  linking  constraint  right-hand  sides  in  (S.) 


Similarly,  let 


))  denote  the  maximal  objective  value  in  problem 


(p)  under  the  allocation  b 


1 < i < m,  1 < j < N.  That  is 


f .*  . .* 

Definition : A feasible  allocation  (b'L'  , ...  , b ' ' ) is  dominated 

if  there  exists  another  distinct  feasible  allocation 
(b^  , ...  , b'N;  ) such  that  v(p|(b^x'  , ...  , b^  )) 


c v(p|(b(l)\  ...  , b^N' * ) ) , 


Also,  a set  S of  feasible  allocations  will  be  called  dominated  if  every 
allocation  (b^x  , ...  , b^)  t S is  dominated.  Clearly,  any  allocation 
or  set  of  allocations  which  can  be  shown  to  be  dominated  will  not  have 
to  be  examined  further  in  the  search  for  an  optimal  allocation. 

Finally,  from  the  definitions  of  the  sets  Fq,  F^,  F^,  etc.,  in 
Chapter  2 (see  equations  (2.16),  (2.17),  (2.18)),  it  is  seen  that  each 


of  the  subsets  Fr  differs  from  the  original  set  of  feasible  allocations 

F , and  other  subsets  F,  , k ^ n,  only  in  the  values  of  the  bounds 
0 K 

b i , b_  on  the  allocation  variables.  Suppressing  the  common  require- 
ments  b ^ < b,  b'J  integer,  for  j = 1,  2,  ...  , N,  the  sets 

d=i 

Fn  may  be  identified  by  these  bounds.  Thus,  in  the  following  discussion, 

we  adopt  the  notation  shown  in  Figure  1 for  representing  the  nodes  in 

the  Search  tree.  The  node  depicted  in  Figure  1 would  correspond  to  the 

set  F defined  by  F = {(b''  b ‘^ ) | b^  ^ < b,  b.  . < b,  . 

n n v 1 M - * -ij  - i j 

- J 

c b,  b,  . integer,  for  1 5 * 5 m» 


3.2  Branching  in  the  RBBA 

The  branching  rule  developed,  in  this  section  is  motivated  primarily 
by  the  desire  to  keep  as  small  as  possible  the  number  of  allocations 
which  must  be  examined  overall  in  the  course  of  the  search.  This  object'- ve 
is  accomplished  by  first  recognizing  that  non-zero  slacks  in  the  optimal 
subproblem  solutions  can  be  used  to  identify  dominated  allocations,  and 
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Figure  1:  Representation  of  node  n in  the  search  tree 


then  branching  in  such  a way  as  to  eliminate  these  allocations  from 
further  consideration.  The  procedure  is  derived  from  the  following 
simple  results. 


Theorem  1:  Consider  the  block  angular  problem  (P),  and  let 

~ -x- 

(b^  , ...  , b^  ) be  a feasible  allocation.  Suppose 
subproblem  (S.  ) is  solved  using  the  vector  of  linking 

J0  (JJ* 

constraint  right-hand  sides  b . Assuming  (S.  ) is 


feasible  under  the  allocation  b u , let 

(j0) 

x denote  the  optimal  solution,  and  s = 

(s  , , s . ) the  corresponding  vector  of  slacks  in 
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the  linking  constraints.  That  is, 


allocation  (b 


is  dominated 


Let  j index  some  other  subproblem  (S.  ),  where  1 < < N, 

1 Ja  J- 

fl)’  w (n) ? 

and  consider  the  allocation  (bv  , ...  , b'  ) defined  by 


We  will  show  that  the  allocation  (b 


is  dominated 


Firstly,  under  the  hypothesis  that  s 


) are  distinct.  Hence,  consider  the  problem 


maximize 


subject  to 


the  set  of  feasible  solutions  to 


ko 


a subset  of  the  set  of  feasible  solutions  to  (S^  ).  However,  since 

(jJ  (jJ*  (JJ*  (dJ*  (J0)  * (dJ* 


AW  W . vy  W 1 

x = b - s = b 


is  still  feasible  for 


(S’.  ),  and  hence  must  also  be  optimal  for  (S’.  ). 

J°  (Ji)*  (Jx)*  J°  (jJ* 

Thus,  since  b > b , and  since  x is  optimal  for 

both  (S.  ) and  (S’.  ),  it  follows  from  (l)  that 


=v(SJ|b(j)>)  , 

i (do)r 

= v(S.  |b  ), 

J0 

for 

J = 1,2 

for 

J = jQ 

, (dl)f 

< v(s.  lb  ), 

for 

0 = j-L 

a /•■)*  N /.x, 

Summing  over  j in  (2),  £ v(s.|b^j;  ) < v(S.|b'J^  ),  or,  equiva- 

j=l  J “ j=l  J 


J=1  J d=l  J 

lently,  v(p|(b^  , ...  , b^K)  ))  < v(p|(b^\  ...  , b^')) 


It  follows  by  definition  that  the  allocation  (b^  , ...  , b^  ) 
is  dominated. 

Q.E.D. 

Corollary:  Under  the  same  hypotheses  as  in  Theorem  1,  and  with  the  allo- 

flV  CnV 

cation  (bv  , ...  , bv  ) defined  by  (l),  the  set  of 


allocations 


...  , b(l,))  £Fnlb(Jo)’  <bUo)  <b(do>  , b°0>  ^b(')o>‘) 


is  dominated. 


Proof:  Arguing  as  in  Theorem  1,  each  allocation  (b^,  ...  , b^)  e S 

(l)»  (jr)t 

can  be  shown  to  be  dominated  by  the  allocation  (b'  , ...  , bv  ' ). 


Q.E.D. 


For  completeness , it  is  also  necessary  to  consider  the  case  where 
one  of  the  subproblems  (S.)  is  discovered  to  be  infeasible  under  a given 
allocation  (b^  , ...  , b^  ). 


Theorem  2:  Consider  the  allocation  (b'  , ...  , b^1  ) e F^,  and 

suppose  the  subproblem  (S.  ) is  found  to  be  infeasible  when 


solved  using  the  vector  of  linking  constraint  right-hand 


Then  (b 


is  dominated 


Proof:  Adopting  the  standard  convention  that  v 


it  follows  that 


is  infeasible  under  b 


Hence  (b 


nated  by  any  other  allocation  (b 


Corollary:  Under  the  same  hypotheses  as  in  Theorem  2,  the  set  of  allO' 


is  dominated 


) must  also 


Proof:  For  each  allocation  (b 


The  result  follows  by  Theorem  2 


be  infeasible  under  b 


Theorems  1,  2,  and  their  corollaries  are  the  main  results  on  which 


the  branching  rule  is  based.  Specifically,  we  wish  to  branch  in  such  a 


way  as  to  rule  out  of  further  consideration  any  set  of  allocations  S 


satisfying  either  (3)  or  (4).  Suppose  at  a given  node  n in  the  RBBA 


the  allocation  (b 


is  selected  to  be  examined 


next,  and  subproblem  (S.  ) is  solved  using  b 


if  (S.  ) is  feasible  under  b 


is  infeasible  under  b 


is  as  in  Theorem  1 and  M is  an  arbitrarily  large  number 


Then  using  the  notation  in  Figure  1,  the  branching  at  node  n is  done 


as  indicated  by  Figure  2.  The  bounds  b 


in  subproblem  (s.  ) at  node  n+1  are  revised  as  a result  of  the  branching 


procedure.  Each  of  the  right-hand  branches  added  to  the  search  tree  in 


Figure  2 defines  a new  subset  F,  to  be  added  to  the  list  and  examined 


represented  by  node  n+1  is  considered 


later.  However,  the  subset  F 


The  new  bounds  on  the  allocation  variables  b 


) at  node  n+1  are  given  by 


then 


under  the  vector  of  linking  constraint  right-hand  sides  b 


is  as  defined  in  (1) 


m,  where  b 


and  it  follows  from  the  corollary  to  Theorem  2 that  every  allocation 

(Iq)  (Jq)  w 

in  Fn+j_  is  dominated,  except  those  with  b = b .—  Conse- 
quently, we  can  fix  the  allocation  variables  in  subproblem  (s.  ) at 

u0>  (y  J° 

the  values  b = b at  node  n+1,  and  also  in  any  nodes 

descendant  from  node  n+1,  thereby  ruling  out  of  further  consideration 
the  set  of  allocations  S defined  by  (3).  Moreover,  since,  as  seen 

OJ* 

in  Theorem  1,  the  optimal  solution  x obtained  in  (s.  ) under 

(V*  V J° 

the  allocation  b remains  optimal  under  b , it  will  not 

be  necessary  to  resolve  the  subproblem  at  node  n+1,  nor  at  any 

of  its  descendants. 

Similar  remarks  apply  if  (S.  ) was  infeasible  under  the  vector 

J0  , . N* 

of  linking  constraint  right-hand  sides  b . In  this  case,  it  is 


sufficient  in  (5)  to  choose 


. T v 

) > 


1 < i < m 


where  here  b. . is  the  initial  lower  bound  on  b..  , i = 1,2,. ..,m, 

-u0 

used  in  defining  the  set  Then  after  branching  as  in  Figure  2, 

the  set  Fn+1  corresponding  to  node  n+1  consists  of  all  allocations 
/'■)')  (lvr\  Un) 

(b'  , ...  , bv  v)  e Fn  with  b < b .By  the  corollary  to 

Theorem  2,  all  these  allocations  are  dominated:  hence,  F , is  fathomed. 
In  this  way,  the  desired  result  is  achieved:  the  set  S of  dominated 

allocations  defined  in  (4)  is  ruled  out  of  further  consideration. 


— Note  that  if bTi < b. . for  some  i = 1,  2,  ...  , m (where  here 
iJ0  1J0 

b. . is  the  lower  bound  on  b. . in  the  initial  set  F ),  the  set  F 
~iJn  ^ n l 

consists  entirely  of  dominated  allocations.  In  this  case,  node  n+1  is 

immediately  fathomed. 
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The  branching  procedure  is  clarified  with  the  aid  of  a small  example 


Consider  the  problem 


maximize 


subject  to 


Problem  (8)  is  a block  angular  integer  program  of  the  form  (P),  with 


m = 2 linking  constraints  and  N = 3 subproblems.  Using  equations 


(24),  (23)  of  Chapter  2,  the  initial  bounds  0 < b. . < 15>  0 < b. . <10 


Suppose  the  initial  allocation  (b 


9,0;  4,0)  is  selected  for  examination  at  node  0.  Problem  (8)  decom 


poses,  and  the  first  subproblem  becomes 


— This  example  is  taken  from 'Hillier  and  Lieberman  (197*0  > P*  145  • The 
right-hand  sides  in  the  linking  constraints  have  been  halved,  and  integer 
restrictions  imposed  on  x , j = 1,  2,  ...  , 8. 


(S,)  maximize  8xn  + 5x0  + 6x,  , 


subject  to 


/\.  I Jl  . 

The  optimal  solution  to  (S,)  is  easily  seen  to  be  xv  = (x  ,x ,x,) 

X . .*  1 d 
= (0,0,2),  so  that  in  this  case  the  slack  veci  is  s'  ' = (sn,s21^ 

= (2,2).  By  the  corollary  to  Theorem  1,  the  set  of  allocations 

S = {(b(1),b(2),b(3))  |(0,8)  < (bi;L,b21)  < (2,10),  (bn,b21)  4 (0,8)) 

is  immediately  seen  to  be  dominated,  and  the  partitioning  of  FQ  is 

carried  out  as  shown  in  Figure  3.  At  node  1 in  Figure  3,  and  also  in 


any  of  its  descendant  nodes,  the  allocation  variables  in  the  first  sub- 
problem may  be  fixed  at  b^  = 0,  b^  = 8,  since  all  other  allocations 
in  the  set  F,  represented  by  node  1 are  dominated.  As  in  Theorem  1, 

x = (0,0,2)  remains  optimal  for  the  first  subproblem  in  the  case 

. . * 

b'  = (0,8) , and  consequently,  subproblem  1 will  not  need  to  be 
resolved  at  any  nodes  descendant  from  node  1. 


3»3  Additional  Comments  on  the  Branching  Procedure 


The  above  example  also  serves  to  illustrate  that  often  it  will  not 
be  necessary  to  add  to  the  search  tree  all  of  the  branches  indicated  in 
Figure  2.  The  general  branching  procedure  generates  two  new  subsets 


for  each  allocation  variable  b. . , i = 1,  2,  ...  , m,  in  the  subproblem 

iJ0 


* * * — 
b.  . < bf  . - 1 = b.  . - s.  . -1.  However,  if  b.  . = b.  . 

Vo  Vo  Vo  Vo  Vo  Vo 


(where  b.  . represents  the  upper  bound  on  b.  . in  the  initial 

Vo  Vo 


set  F ),  the  set  F is  obviously  empty,  since  in  this  case  b.  . 

n ni  Vo 


■¥r  — 

would  be  required  to  satisfy  b.  . + 1 < b.  . < b.  . = b.  . . 

Vo  oJo  Vo  Vo 


%■  * 

Similarly,  if  b!  . = b.  . - s.  . = b.  . , the  set  F is  empty. 

Vo  ~ Vo  Vo  Vo  n2 


In  either  case,  the  corresponding  branch  in  Figure  2 .s  omitted.  In 


terms  of  the  example,  note  than  neither  the  branch  b^  < b - s^  - 1 


(=  -l)  nor  the  branch  b^  > bg  + 1 (=  ll)  is  included  in  Figure  3. 


It  should  be  noted  that  the  allocation  (b 


(1)’ 


, ...  , b^  ) defined 


by  (l)  is  used  only  to  facilitate  the  proof  of  Theorem  1.  In  general, 

(J„>* 


‘O' 


the  slacks  s ^ may  be  re-allocated  among  several  other  subproblems 
in  a more  promising  manner  than  in  (l)„  This  point  is  developed  in 
Chapters  4 and  5- 


C i) » (u) i 

In  any  event,  the  definition  of  the  allocation  (bv  , ...  , b'  ' ) 


in  Theorem  1 presupposes  the  existence  of  another  subproblem  (s . ) to 

(j0)*  J1 

which  the  unused  resources  s may  be  re-allocated.  By  the  time 


the  subproblem  (S^)  is  solved,  however,  the  allocations  to  the  previous 


N-l  subproblems  have  already  been  fixed  in  accordance  with  the  branching 


procedure  described  above,  and  cannot  be  revised.  This  difficulty  is 


resolved  by  noting  that  once  the  allocations  bVlJ  , j = 1,  2,  ...  , N-l 


(J) 


are  fixed,  there  is  only  one  feasible  allocation  of  interest  in  (S^), 


namely, 


b(N)  = b - "l  b^ 


(9) 


j=l 


Any  allocation  which  uses  less  than  all  of  the  remaining  linking  resources 
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in  (S  ) is  dominated  by  the  allocation  in  (9).  Consequently,  no  branching 
is  required  following  the  solution  of  the  subproblem  in  Step  4 


of  the  RBBA.  Step  5 is  bypassed,  and,  jumping  to  Step  2 instead,  a new 

subset  F,  is  selected  for  examination  next, 
k 

The  advantages  of  adopting  the  branching  procedure  described  in 

Section  3-2  are  several.  Firstly,  the  procedure  enables  the  search  tree 

to  be  proved  substantially  (and  quickly)  by  eliminating  searches  over 

the  dominated  sets  S as  defined  in  (3)  or  (4).  This,  of  course,  has 

been  the  primary  motivating  force  in  its  development.  Secondly,  the 

procedure  provides  an  easy  decision  rule  for  use  in  Step  5 in  the  RBBA 

presented  in  Chapter  2.  The  choice  of  the  branching  variables  and  the 

specification  of  the  bounds  used  in  the  partitioning  process  result 

directly  from  the  subproblem  solutions  obtained  in  Step  4,  with  only 

minor  additional  computational  effort  required.  Thirdly,  in  general 

only  one  subproblem  (S.)  will  be  solved  in  Step  4 in  the  RBBA  before 

J 

the  given  allocation  is  recognized  to  be  dominated.  Jumping  then  to 
Step  5 and  branching  as  described  above,  the  unused  resources  s'“ 
discovered  in  solving  (S.)  can  be  reallocated  to  the  remaining  subproblems, 
thereby  possibly  yielding  an  improved  allocation  overall.  Finally,  the 
branching  procedure  allows  the  objective  function  bounds  computed  at  sub- 
sequent nodes  to  be  tightened,  and  thereby  can  aid  in  fathoming  in  the 
RBBA.  Since  in  the  resultant  node  n+1  in  Figure  2 the  allocation  to 

(jj  (dJ*  (JJ*  (JJ* 

subproblem  (S.  ) is  fixed  atb  =b  = b -s  , the 

exact  (integer  programming)  objective  value  obtained  in  (S.  ) can  be 

J0 

used  when  computing  the  upper  bound  U on  the  objective  function  value 


in  (P)  in  Step  3*  This  of  course  holds  for  all  nodes  descendant  from 
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fixed  at  these  nodes.  These  last  remarks  are  clarified  in  Chapters  4 

. 


CHAPTER  4 


COMPUTING  BOUNDS:  SINGLE  LINKING  CONSTRAINT  CASE 

In  this  chapter  we  are  concerned  with  Step  3 of  the  RBBA  presented 
in  Chapter  2,  i.e,,  the  problem  of  computing  an  upper  bound  U on  the 
maximal  objective  value  attainable  in  (p)  under  any  allocation 
(b^',  ...  , bvN')  in  a given  subset  F^  of  feasible  allocations. 

To  this  end,  a Master  Problem  associated  with  (p)  is  introduced  in 
Section  4.1.  The  solution  to  this  problem  provides  the  desired  bound 
U.  In  addition,  in  the  case  that  the  upper  bound  U does  not  fathom 
F^,  the  solution  of  the  Master  Problem  generates  a promising  allocation  - 
as  required  in  the  second  part  of  Step  3 - which  may  be  selected  next 
for  further  examination  in  Step  4. 

When  the  original  block  angular  problem  (p)  has  only  a single  linking 
constraint  (as  might  be  the  case,  for  example,  for  a multidivisional 
corporation  in  which  the  subdivisions  are  tied  together  only  by  a cor- 
porate-wide capital  budgeting  limitation),  the  Master  Problem  itself 
takes  on  a special  structure  which  gives  rise  to  a specialized  and  very 
efficient  solution  procedure.— ^ For  this  reason,  the  discussion  of  the 
bounding  procedure  in  this  chapter  is  devoted  entirely  to  the  single 
linking  constraint  case.  Although  the  fundamental  concepts  involved 
in  generating  the  objective  function  bounds  ana  trial  allocations  in  the 
multiple  linking  constraints  case  are  quite  similar  to  those  developed 

— In  fact,  in  this  case  the  Mast  r Problem  is  seen  to  belong  to  the 
broader  class  of  concave-separable  integer  programs  discussed  in  Kochman 
(1976). 
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here,  discussion  of  the  details  of  the  bounding  procedure  when  there  is 
more  than  one  linking  constraint  is  deferred  to  Chapter  5» 


4.1  The  Master  Problem 

The  transformed  block  angular  problem  (P*)  given  by  (2.7)-(2.10) 
might  itself  be  rewritten  in  the  form. 


maximise  ^ f.(VJ  ) , 


subject  to 


S b<J><6 

3-1 

b(j)  < b(J)  < b(j)^  b(j)  integer  for  j = 


where  for  each  j = 1,  2,  ...  , N,  b^  = (by,  •••  > = 

(by,  ...  , by),  and  fj(b^)  is  the  maximal  objective  function 
value  in  subproblem  (s^),  as  a function  of  the  vector  b^  of  linking 
resources  allocated  to  (S^).  That  is, 

f (b^)  = max  c^x^  , 

J 


subject  to 


A(d)x(j)  < b(j) 
*“>  > 0,  intej 


integer  , 


for  j = 1,  2,  ...  , N. 

From  the  definition  of  the  set  F^  of  feasible  allocations  in 
(2.16),  it  is  apparent  that  problem  (l)  can  be  more  compactly  expressed 


53 


N 


(b 


maximize 

(l),...,b(N))eFr 


(j)' 


2 f1(bVJ/)  . 
j=i  0 


(3) 


Moreover,  as  discussed  in  Section  3.1,  the  subsets  F^  of  F^  generated 

in  the  course  of  the  RBBA  differ  from  each  other  only  in  the  values  of 

the  upper  and  lower  bounds  b. b. . on  the  allocation  variables  b. 

ij  -ij  ia 

1 < i < m,  1 < j < I.  Consequently,  the  problem  of  determining  the 
maximum  objective  value  attainable  in  (P)  by  any  allocation  in  a given 
subset  Ffi  can  be  represented  by 


N 


(b 


(1) 


maximize 


.,b^)eF  3 1 ° 

’ n 


2 f\(b(j)) 


by  revising  the  bounds  b^,  b^,  j = 1,  2, 
ately. 


O) 


, N,  in  (1)  appropri- 


In  order  to  derive  an  upper  bound  U on  the  optimal  objective  value 

in  (k),  consider  the  relaxation  of  (^-)  obtained  by  replacing  the  objective 

function  components  f.(b.;,-'  j = 1,  2,  ...  , N,  with  their  linear- 

J 0 


programming  approximations.  That  is,  for  j = 1,  2, 


, N,  let 


W 1 


max 

subject  to 


A^'x^  < b^ 


(5) 


x^  > 0 , 


— ^ When  the  block  angular  problem  (P)  has  only  a single  linking  constraint, 
the  matrices  A ^ contain  only  one  row,  and  the  vector  of  allocation 
variables  b^^  reduces  to  a scalar.  In  identifying  the  individual  allo- 
cation variables  b..,  we  therefore  suppress  the  first  subscript,  and 

write  b'J  = (b.  .)  = b.  in  the  following  discussion. 

• J <3 

5^ 


and  consider  the  problem, 


(MP) 


N 

maximize  z.(b.)  , 

0=1  J J 


subject  to 


b.  < b 

J - 


b.  < b.  < b.,  b. 
-0  ~ 0 ~ 0 0 


integer,  for  j 


1,2, 


,N  . 


Insofar  as  problem  (MP)  serves  to  coordinate  the  activities  of  the  sub- 
problems, we  refer  to  (MP)  as  the  Master  Problem,  borrowing  loosely  from 
the  terminology  of  Dantzig  and  Wolfe  (i960).  It  is  clear,  since  (5)  is 
a relaxation  of  (2),  that  z,(b.)  > f.(b.)  for  all  b.  < b.  < b., 

jo-jo  -0-0-0 

0 = 1,  2,  ...  , N,  and  so  the  maximal  objective  value  in  (MP)  indeed 

generates  an  upper  bound  for  the  objective  value  in  (4). 


4.2  Solving  the  Master  Problem 

In  the  presence  of  a single  linking  constraint,  problem  (5)  may  be 

considered  as  a parametric  linear  program,  and  can  be  solved  by  standard 

linear  programming  techniques.  It  is  well-known  that  the  resulting 

functions  z.(*)  defined  in  (5)  will  be  concave  and  piecewise  linear; 

J 

that  is,  each  z.(b.),  j = 1,  2,  ...  , N,  has  the  form  shown  in  Figure  1. 

J J 

As  such,  and  because  of  the  integer  restrictions  on  the  allocation  vari- 

ables  b , j = 1,  2,  ...  , N,  (MP)  is  a concave  separable  integer  program. 
J 

This  class  of  problems  is  defined  and  discussed  in  greater  generality 
in  Kochman  (1976).  The  algorithm  developed  in  this  section  for  solving 
the  problem  (MP)  is  a specialized  version  of  the  procedures  presented 
there. 
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Figure  1:  Form  of  the  concave  and  piecewise  linear  function  z (b.) 

J 0 


Ignoring  the  integer  restrictions  on  the  b.,  j = 1,  2,  ...  , N, 

J 

for  the  moment,  (MP)  becomes  a concave-separable  linear  program  in  bounded 

variables.  As  shown  in  Figure  2,  let  p.,  denote  the  kth  breakpoint 

of  z.(b.),  including  the  lower  and  upper  bounds  b.,  b..  Let  K. 

JO  0 J J 

denote  the  number  of  such  breakpoints,  so  that 


p.,  = b . , and  p.  = b . . ((. 

Fjl  -y  jK,  J V 

J 

Without  loss  of  generality,  we  may  assume  that  p^,  p^K  are  integer- 

J 

valued. 


Let  s (k  = 1,  2,  . . . , K.  - 1)  denote  the  slope  of  the  k 
jk  J 

segment  of  z (b.),  and  a.,  the  intercept.  Then,  for  j = 1,2,...,N, 
J J 

z.(b.)  may  be  written  as 
J J 


i i 


Figure  2:  Breakpoints  p.,  and  auxiliary  variables  y 

0 k j K 

associated  with  z.(b.) 

J J 


W - Vj  + <v  for  p3k ibj  s fjk*i'  k ■ 1’2’---'Y1  ■ (7) 


To  linearize  (MP),  the  auxiliary  variables  y.,  (k  = 1,  2,  ...  , K.-l), 
j = 1,  2,  ...  , N)  are  introduced  as  indicated  in  Figure  2.  We  can 
then  write 


where  each  y..  is  bounded  by 


K.-J 

J 

+ s 

k=l 


Also,  for  j = 1,  2,  ...  , N, 


z . = 


V1 

SjlPjl  + Cti1  + Sjkyjk 


(10) 


It  is  easy  to  see  that  (lo)  gives  the  same  results  as  (7)  whenever  b. 

0 

and  y (k  = 1,  2,  ...  , K . - l)  are  related  as  in  (8),  (9),  provided 

that  no  y.k>0  unless  yjk-1  = Pjk  - P^,  i.e.,  unless  y.^  is 
at  its  upper  bound. 

Still  ignoring  the  integer  restrictions  on  the  allocation  variables 
b.  (j  = 1,  2,  ...  , W)  and  using  (8),  (9),  (10),  (MP)  becomes 


2 (■jifji  * 


N -i 

2 t 

j=l  k=l 


K . -1 


J=1 


jl' 


max 


Vjk  » 


subject  to 


» V1 


2 E yJk  - >>  - E p. 


on 


0=1  k=l 


0=1 


01 


0 - yjk  - Pjk+1  " Pjk’  d k - 1,2,...  ^-1  . 

It  is  a standard  result  of  the  theory  of  concave-separable  linear  programs 

that  the  optimal  solution  to  (ll)  will  naturally  satisfy  the  condition 

that  no  y.,  > 0 unless  y , = p - p . Thus,  (ll)  is  equivalent 
0-K  JK-X  0*  JK-X 

to  the  LP  relaxation  of  the  Master  Problem  (MP). 

Note  that  (ll)  itself  is  a linear  programming,  bounded-variable 
knapsack  problem,  and.  so  its  solution  is  almost  trivial.  The  general 
LP  bounded-variable  knapsack  problem  is  of  the  form, 
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maximize 


subject  to 


Y)  a .x.  < b 

LJ  i i — 


0 < x . < x . , 
- 0 - 0 


where,  without  loss  of  generality,  c . > 0,  a . > 0,  j = 1,2,..., n.— 

0 J 

The  solution  to  (12)  is  obtained  by  first  computing  the  ratios 

c./a.,  j = 1,  2,  ...  , n,  and  reordering  the  variables  x.  so  that 
0 0.  0 

c.  /a.  > c.  /a.  >•••>  c.  /a.  . (] 

0X  0-l  02  02  0n  0n 

Then,  starting  with  x.  and  proceeding  sequentially  to  x.  , x.  , 

0 0 2 0 j 

etc.,  each  variable  x.  is  set  to  its  upper  bound  x.  until,  for 

Ji  Ji 

some  index  p, 


P-1  P 

a . x . < b , but  £ a . x . > b . 


i»l  Ji  Ji 


ill  ^ Ji 


Next,  x.  is  set  to  (b  - V*,  a.  x.  )/a.  , and  x.  is  set  to  zero 

Jp  itl  Ji  Ji  Jp  Ji 

for  i = p+1,  p+2,  ...  , n.  Thus,  if  p is  that  index  for  which  (14) 

holds,  the  optimal  solution  to  (12)  is 


— If  any  c > 0 and  a < 0,  it  is  always  optimal  to  set  x = x , 

thereby  eliminating  x^  from  the  problem.  Similarly,  if  any  c^  < 0 

and  a^  > 0,  set  x^  = 0.  Finally,  if  any  c^  < 0 and  a^  < 0,  make 

the  transformation  x ' = x - x . Substituting  x’  for  x in  (12) 

k k k k k • 

then  renders  c,'  >0,  a'  > 0. 

k - k 
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where  the  indexing  sequence  j . is 


Problem  (ll)  is  a special  case  of  problem  (12)  in  which  each  con 


straint  coefficient  is  identically  equal  to  1.  Thus,  the  sequence  j 


in  (13)  in  this  case  can  be  obtained  simply  by  reordering  the  s 


1 < j < N,  l<k<K.  -1,  in  non-increasing  order  since  no  divisions 


If  (ll)  is  solved  by  the  procedure  outlined  above,  it  is  clear  from 


15)  that  at  most  one  y 


will  not  be  at  its  upper  or  lower 


bound  in  the  optimal  solution  y 


Hence,  if  the  upper  bound  (9)  on  each  y.,  is  integer,  each  y. 

(jk  i rp)  will  be  integer.  But  then  the  single  functional  constraint 
of  (ll)  shows  that 


yrP  ' b - £ 1 L*  ' 1“‘"»  ' 

jMrp 

Therefore,  when  each  upper  bound  " P^k  in  (9)  is  integral 

it  follows  that  there  exists  an  optimal  LP  solution  to  (11)  which  is 
naturally  integer.  By  the  equivalence  between  (ll)  and  the  Master 
Problem  (MP),  this  solution  yields  the  optimal  LP  solution  to  (MP)  via 
(8).  Furthermore,  from  (8)  and  the  fact  that  each  y . , j = 1>2,...,: 


1,  ii-  nature  Lly  integer  in  the  optimal  solution 


it  follc**s  that  each  b 


integer-valued  at  the  LP  optimum  to 


The  discussion  above  has  thus 


established 


Theorem  1:  Whenever 


k = 1,  2,  ...  , K.  - 1,  the  optimal  integer  solution  to  the 
J 

Master  Problem  (MP)  can  be  obtained  from  the  optimal  linear 


programming  solution  to  the  bounded- variable  knapsack  problem 


We  next  show  how  to  modify  the  parametric  objective  functions  z 


N,  in  such  a way  as  to  obtain  an  equivalent  problem 


(MP')  to  (MP)  in  which  all  the  breakpoints  p 


con 


dition  obviously  implies  that  p - p will  be  integral  for  all 

JK+X  JK 

j,  k,  and  so  the  solution  procedure  described  above  may  be  applied  to 


The  procedure  for  modifying  z.(b.)  is  the  same  for  each 

J J 

.,  2,  ...  , N.  Hence,  consider  z.(b.)  for  some  arbitrary  but 


fixed  j.  Recalling  that,  without  loss  of  generality,  p and  p. 


may  be  assumed  to  be  integral,  let  p 


be  any  non' 


integer  breakpoint  of  z 


We  seek  to  remove 


breakpoints  of  z.(*)  by  creating  two  new  breakpoints  at  [p  ] 


accomplished  by  replacing  z.(b.)  for  [p  < b,  < < P 


straight  line  segment  from  the  point  ([p  . ],  z.([p..]))  to  the  point 


, as  shown  in  Figure  3-  It  is  easy  to  see  that 


this  modification  preserves  the  concavity  of  z 


Equally  important 


(for  reasons  that  will  be  seen  shortly),  the  value  of  z 


is  changed 


under  the  modification  procedure  only  between  integer  values  of  b 


The  slope  s and  intercept  a of  the  modified  segment  of  z (•) 

J 


are  easily  computed: 

z.(<  P..  >)  - z ([p  ]) 

s ' <^>  -1^—  - 1(<  po* >]  * *j(tV>  ’ 


(16) 


since  < p.„  > - [ p . „ ] = 1 for  non-integer  p...  Also,  since  the  value 
J* 

of  z (b.)  at  b . = [p.»]  is  unchanged, 

,7  j J J 


a - ‘ s[V  ' 


(17) 


Letting  z’(b.)  denote  the  function  which  results  from  modifying  z (b  ) 
0 0 0 0 

as  in  Figure  3,  we  have,  specifically, 
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where  z 


The  modified  function  z 


does  not  have  a breakpoint  at 


Instead,  the  integer  points  b 


are  breakpoints  of  z 


while  they  may  not  have  been  breakpoints 


of  the  original  function  z 


Usually,  therefore,  the  modification 


procedure  results  in  increasing  the  total  number  of  breakpoints  by  one 


for  each  non-integer  breakpoint  of  z 


< p.«  > or  both  are  natural  breakpoints  for  z 


or  if  the  interval 


] < b.  < < p.„  > contains  more  than  one  breakpoint  of  z 


that  all  are  eliminated  simultaneously  by  the  same  segment),  then  the 


number  of  breakpoints  can  remain  the  same  or  even  decrease  following 


the  modification 


The  modification  procedure  is  the  same  for  each  non-integer  break' 


point  p 


The  resulting  function  z 


cedure  for  each 


N leads  to  the  problem 


maximize 


subject  to 


....  . : . 


Since  only  integer  solutions  to  (MP)  are  of  interest,  and  z!(b  ) 

J J 

= z . (b  ) at  all  integer  values  of  b.,  b.  < b.  < b.,  j = 1,2,...,N, 
it  is  clear  that  (MP*)  and  (MP)  must  have  the  same  optimal  solutions. 

We  may  therefore  solve  (MP')  in  place  of  (MP).  However,  since  all  break- 
points of  z'(b.),  j = 1,  2,  ...  , N,  are  integer,  it  follows  by  the 
J J 

arguments  above  that  the  integer  restrictions  on  b.,  j = 1,  2,  ...  , N, 

0 

in  (MPJ)  are  redundant  and  may  be  dropped.  Moreover,  since  the  z\ (b.), 

0 0 

j = 1,  2,  ...  , N,  remain  concave  and  piecewise  linear  under  the  modi- 
fication procedure,  (MP1)  is  a concave  separable,  bounded-variable  LP 
knapsack  problem,  and  may  be  efficiently  solved  using  the  procedure 
described  above. 

In  practice,  it  is  not  necessary  to  introduce  the  auxiliary  variables 

y explicitly  in  solving  (MP*).  Because  each  constraint  coefficient 
Jk 

in  (MP')  is  unity,  the  LP  solution  procedure  for  problem  (ll)  reduces 
simply  to  sequentially  choosing  the  largest  (remaining)  s.,  and  setting 

Jk 

the  corresponding  variable  y to  its  upper  bound.  But  since  each 

Jk 

z\ (b.)  is  concave,  j = 1,  2,  ...  , N,  we  have  for  each  j that 
J J 


s > s , , 
jk  - jk+1 


k = 1,  2,  ...  , K - 2 . 

J 


(1*0 


Thus,  in  terms  of  the  original  variables  b.,  j = 1,  2,  . . . , N,  the 

J 

solution  procedure  amounts  to  searching  over  j for  that  (remaining) 

segment  k of  z.(*)  with  largest  slope  s , and.  increasing  the 
J Jk 

corresponding  variable  b.  from  p.,  to  p . That  is,  b.  is 

J Jk  jk+l  j 

increased  to  its  next  larger  (integer)  breakpoint  value.  When  such  an 

N 

increase  would  result  in  making  ^ b.  > b,  the  chosen  variable  b 

d=i  J r 

is  set  to  b = b - J)  b,  instead,  and  the  procedure  is  terminated. 

r jXr  J 


6k 


The  procedure  for  solving  the  Master  Problem  (MP)  in  the  case  that 
the  original  block  angular  problem  (p)  has  only  a single  linking  constraint 
is  now  presented  in  algorithmic  form. 


Algorithm  for  Solving  (MP);  Single  Linking  Constraint 


Step  Q.  For  j = 1,  2,  ...  , N,  solve  subproblem  (S.)  parametrically 

J 

in  b . to  obtain  the  functions  z.(b.).  Modify  z.(b.)  as 
1 11  11 

discussed  above  to  eliminate  all  non-integer  breakpoints  of 

zi(iiu 

Step  1.  (initialization.)  For  j = 1,  2,  ...  , N: 

* 

Set  b . = p . . = b . . 

1 !l  -1 

Set  k.  = 1. 

1 



Step  2.  Find  an  r (l  < r < N)  such  that  b < b and  s > s .. 

- “ r r rkr  - 

Vj  = 1,  2,  ...  , N such  that  b.  < b.. 

J J 


Step  3 . Reset  k = k +1. 

— r r 

* 

Then,  reset  b = p , 
r rk 


Step  U.  (Check  for  termination.) 

N * * 

If  T/  b reset  b = b - b . and  stop 

1=1  J r jXr  J 

(b  . , j - 1,  2,  , . . , N,  is  optimal  for  (MP)). 

i 

Otherwise,  go  to  Step  2. 


In  Step  1 of  the  algorithm,  each  variable  b . is  initially  set  to 

J 

its  lower  bound  b . The  k (j  = 1,  2,  ...  , N)  are  used  to  index 
J J 

the  segment  of  z.(b.)  which  is  currently  of  interest.  In  the  search 
J J 
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for  the  largest  (remaining)  s 


in  Step  2,  we  know  by  (19)  that  if 


index  k is  updated  appropriately  in  Step  3 


are  considered  for  which 


since  any  b.  which  is  already  equal  to  its  upper  bound 


obviously  cannot  be  feasibly  increased  further.  As  discussed  above,  the 


variable  b which  is  chosen  to  be  increased  next  is  reset  to  its  next 


(Note  that  k is  updated  first  in 


larger  breakpoint  value  p. 


used  in  Step  3 refer  of  course  to  the 


The  breakpoints  p. 


(all-integer)  breakpoints  of  the  modified  functions  z 


The  subsets  F which  are  to  be  searched  differ  from  one  another 


in  the  values  of  the  bounds  b 


N,  on  the  allO' 


cation  variables.  After  the  initial  set  F 


hence  some  care  must  be  exercised  in  initializing  b 


and,  correspond' 


ingly,  the  index  k.,  j = 1,  2 


N,  in  Step  1.  Given  that  this 


is  properly  accomplished,  however,  the  algorithm  above  can  be  used  to 
resolve  (MP)  at  each  node  n in  the  search  tree. 


4 . 3 Using  the  Master  Problem  in  the  RBBA 


The  bounding  step  (Step  3)  in  the  Rudimentary  Branch-and-Bound 


Algorithm  now  can  be  described  in  greater  detail.  Recall  that  the 


objective  in  Step  3 of  the  RBBA  is  to  determine  whether  the  current 


set  F can  possibly  contain  any  allocations  which  lead  to  a better 


overall  solution  to  (p)  than  the  incumbent,  and  if  so,  to  select  one 
such  allocation  for  further  examination.  This  objective  is  accomplished 
by  constructing  and  solving  the  Master  Problem  as  discussed  in  Sections 
4.1  and  4.2. 

Suppose  at  a given  node  n in  the  search  tree,  the  subset  Fn  of 

feasible  allocation  is  to  be  considered  next.  Using  the  algorithm  of 

Section  4.2,  the  optimal  (integer)  solution  b.,  j=l,  2,  ...  ,N,  to 

. <3 

(MP)  is  easily  obtained.—'  The  optimal  objective  value, 


u = 2 MbJ  > (20) 

j=l  J J 

provides  an  upper  bound  on  the  maximal  objective  value  in  problem  (4). 

* * 

If  U < z , where  z is  the  current  incumbent  objective  value,  the 

* 

set  F is  fathomed.  If  U > 2 , however,  the  allocation  b.  = b. 
n j J 

(j  = 1,  2,  ...  , n)  immediately  presents  itself  as  a natural  choice 

for  the  next  allocation  to  be  considered  in  Step  4 of  the  RBBA. 

Consider  again  now  the  branching  procedure  presented  in  Chapter  3. 

Suppose  that  when  subproblem  (S,  ) is  solved  in  Step  4 of  the  RBBA,  it 

w * 

is  discovered  that  the  allocation  b . = b . ( j = 1,  2,  . . . , N)  is  domi- 

J J 

nated.  As  discussed  in  Chapter  3,  this  is  the  case  whenever  the  optimal 

( i0 >*  (V  (j 0) * * 

integer  solution  x in  (s.  ) uses  an  amount  b!  = A x < b. 

J0  J0  ' 

of  the  linking  resource.  After  branching  on  b . in  Step  5 of  the  RBBA, 


— This  solution  is  optimal  for  (MP)  in  the  sense  that  it  generates  the 
maximal  objective  value  which  (MP)  can  attain  over  the  set  F . Note, 
however,  that  the  allocation  b.  = b*,  j = 1,  2,  ...  , N,  still  may  not 

be  optimal  for  (p);  that  is,  it  is  possible  that  v(P|(b^,  ...  , 4^))^ 

v(p|(b',  ...  , b'))  for  some  other  allocation  (b’ , ...  , b')  e F , 

1 N * * 1 N n 

even  though  v(MP|(b1,  ...  , b ))  > v(.MP|(b|,  ...  , b^)). 


the  allocation  in  subproblem  (S.  ) is  "fixed"  at  the  level  b.  = b*. 

30  Jo  J0 

at  the  next  entry  to  Step  3.  Since  each  of  the  slopes  s and  break- 

JK- 

points  p of  z?(b.)  is  unchanged,  it  is  clear  that  in  resolving 
Jk  3 3 

(MP)  now,  the  variables  b^  chosen  to  be  increased  in  Step  2 of  the 

algorithm  above  will  be  selected  in  the  same  order  (and  increased  by 

the  same  amounts  in  Step  3)  as  before,  with  the  exception  that  this 

time  the  allocation  to  (S.  ) cannot  be  raised  above  b.  = b'.  . Con- 

3q  3q  3q 

sequently,  if  the  previously  optimal  allocation  was  saved,  the  Master 

Problem  need  not  be  resolved  from  scratch.  Instead,  starting  with  the 

b.  = b.,  j 4 and  b.  = b'.  (fixed),  (MP)  can  be  efficiently 

33  v 3q  3q 

reoptimized  simply  by  using  the  algorithm  above  to  reallocate  the 

"additional"  units  b.  - b!  of  the  linking  resource  among  the  other 

J0 

subproblems  (S.),  j 4 3n* 

The  fact  that  the  allocations  to  certain  subproblems  are  fixed 
as  a result  of  the  branching  procedure  also  allows  the  upper  bound  U 
defined  in  (20)  to  be  tightened.  Consider  an  arbitrary  node  n in 
the  search  tree,  and  let 


= (1  < j < N|The  allocation  to  (S.)  is  fixed  in  F^} 


Correspondingly,  let 


Jg  — (l,  2,  ...  , N}  - J^ 


The  task  of  finding  an  optimal  solution  to  the  Master  Problem  at  node  n 
in  effect  reduces  to  that  of  optimally  allocating  the  remaining  amount. 


b - 2/  b . , of  the  linking  resource  among  the  unfixed  subproblems , 

JcJ.  J 

where  b.  (j  e J, ) represents  the  level  at  which  the  allocation  to  (S.) 


is  fixed.  The  bound  (2o)  generated  by  the  optimal  solution  b.  = b. 

J 3 

(j  = 1,  2,  . . , N)  to  (MP)  at  node  n may  therefore  be  replaced  by 

the  tighter  bound. 


U'  = Z v(S  lb*)  + £ z,(b*)  , 


where,  v(Sj|b  ),  j e J^,  is  the  (known)  optimal  objective  value  in 
(S.)  under  the  allocation  b.  = b..  Since  U*  < U,  and  UT  can  be 
obtained  at  approximately  the  same  computational  expense  as  U,  it  is 
clearly  preferable  to  use  the  bound  U'  in  attempting  to  fathom  Fn 
in  Step  3 of  the  RBBA. 

Finally,  it  should  be  noted  that  Step  0 in  the  algorithm  for  solving 

the  Master  Problem,  included  for  the  sake  of  completeness  above,  need 

only  be  executed  once  in  the  course  of  the  RBBA.  Specifically , prior 

to  the  start  of  the  RBBA  (as  described  in  Chapter  2),  the  subproblems 

(sp,  j = 1,  2,  ..  , N,  are  solved  as  linear  programs  parametrically 

in  b.  to  obtain  the, functions  z (b.).  These  functions  are  then  modi- 
J J J 

fied  in  accordance  with  the  procedure  presented  in  Section  b.2.  By 

storing  the  slopes  s.,  and  breakpoints  p of  the  revised  functions 

JK  JK 

zpb-)*  it  will  not  be  necessary  to  recompute  these  values  each  time 
j J 

the  Master  Problem  is’  solved. 


CHAPTER  5 


COMPUTING  BOUNDS:  MULTIPLE  LINKING  CONSTRAINTS  CASE 


The  procedures  presented  in  Chapter  while  very  efficient  for 
computing  the  required  objective  function  bounds  in  the  presence  of  a 
single  linking  constraint,  are  inappropriate  for  this  task  when  the 
block  angular  integer  program  (P)  has  more  than  one  linking  constraint. 
The  major  difficulty  which  arises  with  m > 1 linking  constraints  is 
that  the  parametric  linear  programming  problems  (*+.5)  now  become  the 


multi-parametric  linear  programs  (MPLP), 


z . (b^  ^ ) = max 


subject  to 

g{j)x(j)  < g(j) 
x^  > 0 , 


j = 1,  2,  ...  , N,  where  b^ J = (b.  b . ) is  now  an  m-vector 

of  parameters.  Although  several  multi-parametric  linear  programming 
algorithms  have  recently  been  proposed,^  in  general,  the  MPLP  is  a much 
more  difficult  problem  than  the  standard  ( single -parameter ) parametric 
linear  program.  Consequently , direct  methods  for  solving  problems  such 
as  (1)  are  computationally  too  cumbersome  for  use  within  the  present 
context. 


— ^ See  Gal  and  Nedoma  (1972),  or  Van  de  Panne  (1975)-  Duffin' s (197*+) 
modified  Fourier-Motzkin  elimination  procedure  can  also  be  used  for  this 


purpose. 


A second  complication  which  arises  in  the  presence  of  multiple  linking 
constraints  is  in  the  structure  of  the  Master  Probiem  itself : 


maximize 


subject  to 


2 z,(i>(d))  , 

A _ 7 J 

J-J- 


Y)  < b 

j=i 

b(j)  < bU)  < b(J),  b^  integer,  j = 1,2,  . ,N 


While  it  is  again  easy  to  see  that  the  z (b^  ) defined  in  (l)  are  concave 

«D 

and  piecewise  linear,  each  is  now  a function  of  several  variables. 

Therefore,  the  objective  function  in  problem  (2)  is  not  separable,  and 

the  solution  procedure  developed  in  Chapter  4 can  no  longer  be  used- 

The  bounding  method  proposed  in  this  chapter  for  the  multiple  linking 

constraints  case  is  nonetheless  quite  similar  in  spirit  to  the  method 

discussed  in  Chapter  4.  As  before,  a Master  Problem  of  the  form  (2)  is 

introduced,  and  its  use  in  the  BBRA  is  entirely  analogous  to  the  use  of 

problem  (MP)  in  the  single  linking  constraint  case.  For  the  reasons 

mentioned  above,  however,  the  functions  z.(b*''^)  are  not  wholly  computed 

J 

in  advance;  rather,  relevant  "segments"  of  each  z (bv<^)  are  generated 

J 

in  the  course  of  the  algorithm  Moreover,  because  of  the  loss  of  separ- 
ability, a different  linearization  procedure  for  the  concave  integer 
program  (2)  is  required. 


5 • 1 The  Bounding  Procedure 

In  order  to  compute  an  upper  bound  on  the  maximum  objective  value 
which  (P)  can  attain  over  a given  subset  of  feasible  allocations, 

we  utilize  the  dual  multipliers  associated  with  the  linking  constraints 
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in  the  LP-optimal  solutions  for  the  subproblems 


Theorem  1:  Let  z.  denote  the  optimal  LP  objective  value  in  the  j 


subproblem  of  (P),  given  the  allocation  b 


denote  the  LP-optimal  dual  multiplier 


Then 


associated  with  the  constraint 


for  any  other  allocation 


we  have 


Proof:  Consider  the  LP  relaxation  of  the  j subproblem  under  the 


This  may  be  written  as 


allocation  b 


maximize 


subject  to 


where 


The  dual  of  (5)  is 


minimize 


subject  to 


denote  the  optimal  solution  to  (5)  and  (6)  respec 


lively  By  strong  duality 


Now  suppose  that  the  right-hand  side  in  ^5)  is  changed  to  p 


The  dual  to  this  revised 


and  where  Ab 


minimize 


is  still  feasible  for  (9),  it  follows  by  weak  duality 


that  z.  w y ' p v " , where  z.  is  the  optimal  objective  function 

J J 

value  in  the  revised  version  of  problem  (5)-  Thus, 


from  (8) 


from  (7) 


Since  is  the  optimal  colutieo  to  (6),  the  dual  of  (5)/  the 

first  m components  of  ^ must  be  Jr;^  = i = 1,  2,  ...  , m. 

l i J 

This  gives 


z'  < z.  + £ .Ab. . , 

J - 1 ^ ij 


and  (4)  follows  by  noting  that  the  optimal  integer  solution  in  the  j 
subproblem  (corresponding  to  the  allocation  b'd  ) must  yield  an  objec- 


tive value  less  than  or  equal  to  zl . 


Q.E.D. 


The  upper  bound  on  v(S.|b'J'  ) given  by  (4)  can  be  rewritten  as 

0 


follows. 


. + 5)  -Ab.  . = y^p^  + V .(b!,  - b*.),  from  (7)  and  (3) 

1 IS  -It  n y 1J  1]  1J 


in . 

= y\  ^ y^?pp} 


+ y[^(b!. -b  ),  from  the  definition  of 

h ' 1J  if 


Now  define 


III  . 

= y(j)p(J)  + £ y(j)b?. 
Jm+iK i tfi  ij 


m . 

Oj  if1  ym+iPi  ’ 


so  that  z^.  is  independent  of  the  allocation  b'd'  . Again  noting 

that  y!^  = X.,  . for  1 < i < m,  we  have  from  (4)  and  the  last  equation 
1 J 

above  that 
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(S. jb  ^ ) < zn.  + X.  .b! . 

' -1  1 r\  -I  IS  n n in 


- Oj 


ij  iJ 


Once  the  constant  z has  been  computed,  the  bound  (11)  is  a 

( i)  ’ 

function  only  of  the  allocation  bvo  . Hence,  in  practice  it  wi  .1  be 

r j ) * 

more  convenient  to  use  (ll)  than  (b).  Since  the  allocation  bvd  in 
(11)  is  -.rbitrary,  by  summing  over  j = 1,  2,  ...  , If,  the  maximal 
objective  value  in  (P)  under  any  allocation  (b^,  . . , b^)  can  be 

bounded  by-' 

•••  ,*»>>><£  <*w  ♦£ *„v  ' (12) 

f •)* 

I r.  general,  different  allocations  b^J  lead  to  different  LP-optimal 

base;;  .3.),  and,  consequently,  to  different  sets  of  optimal  dual 

3 

multipliers  (\_,  1 < i < m) . Each  of  ttrse  sets  can  be  used  to  generate 

an  upper  bound  on  v(S.|b^)  as  in  (ll).  Indexing  the  different  sets 

J 

by  th j superscript  k,  and  letting  L.  denote  the  total  number  of  such 

J 

sets  associated  with  the  subproblem  (S.),  we  have 

cJ 

v(S.|b^)  < min  (z^  + \(^b  ) , (13) 


1 < k < L. 

— “ J 


id  iJ 


where  zv,A/  is  computed  from  (10),  for  k = 1,  2,  ...  , L.-  Hence, 

UJ  J 

defining  z_.(b^J)  by 


. f j))  -=-  ^n  (z<*}  + £ X^}b..),  j = 1,2 


1 < k < L. 

- - J 


,N  , (lb) 


I 


— W'  no4',  that,  by  the  way  in  which  (12)  was  obtained,  the  sets  of  dual 
mu:  t ii  . r.;  (x.  1 < i < m)  need  not  be  related  to  each  other  for 

zj  ( i ) * 

dift  ■ j = 1,2,.  .,N.  In  particular,  the  allocations  b u used  to 
obtain  1 . , 1 < i < m) , j = 1,2, . . . ,N,  (as  in  Theorem  l)  are  not 

N (j)* 

requires  to  satisfy  b < b. 

i~i 
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tt  »•  - 


»V— vWw...  »-'■ 


leads  to  the  Master  Problem  (2). 


To  convert  the  concave  (non-separable)  problem  (2)  into  a standard 

mixed-integer  linear  programming  format,  the  objective  function  components 

z (b^)  are  replaced  by  the  auxiliary  variables  z.,  j = 1,  2,  • . . , N. 

3 <3 

The  z.  are  not  restricted  in  sign,  but  from  (14),  are  required  to  satisfy 
J 

z.  < z^  + >)  \^b.  . for  each  k = 1,  2,  ...  , L.: 

j - Oo  .fn  iJ  J 


(MP)  maximize  />}  z ■ > 


subject  to 


f)  b.  . < b. 

_.K  i.i  - i 


, i=l,2,...,m 


Zj  - B ^j\j  1 k=l,2,...,L.,  j=l,2,...,N  (17) 


b.^  1 bij  !ha’  bij  inbeger>  i=l,2,...,m  , j=l,2, . . . ,N  • (18) 

Since  the  objective  (15)  in  (MP)  is  to  maximize  the  sum  of  the  auxiliary 
variables  z y it  is  clear  that  in  the  optimal  solution  (z*,  b^  ), 
j = 1,  2,  ...  , N,  the  implied  equality  in  (14)  will  be  naturally  satis- 
fied^ i.e.,  we  will  have 


z*  = min  (ZS^  + 2/  >^-k^*-)  £ z.(b^^  ),  j = 1,2,...,N  , 

v m lj  - j'  ’ ° ’ 


1 < k < L. 

- - 1 


as  desired.  Thus,  the  Master  Problem  (MP)  above  is  equivalent  to  problem 


(2)  when  the  concave  functions  z.(b  '"  ) are  as  given  by  (l4). 

J 

Each  of  the  slopes  s of  the  different  segments  of  z.(b.)  defined 

Jk  J J 

in  Chapter  4 is  exactly  the  dual  multiplier  associated  with  the  (single) 

linking  constraint  in  the  basis  that  is  optimal  for  (S.)  at  b.  = p.,  • 

J J 
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Thus,  there  is  a strong  analogy  between  the  Master  Problem  (MP)  above 

and  that  introduced  in  Chapter  4 for  the  single  linking  constraint  case. 

(k) 

Each  of  the  sets  of  multipliers  , 1 < i < m} , k = 1,  2,  ...  , L., 

J 

defines  a different  segment  (hyperplane)  of  the  concave  and  piecewise 

linear  function  z.(b^).  In  fact,  the  task  of  explicitly  computing 
J 

the  z.(b^l))  in  (lh)  is  tantamount  to  solving  the  multiparametric 
J 

linear  program  (l).  As  has  been  previously  noted,  however,  this  can 

be  a computationally  unattractive  approach  for  our  purposes 

Rather  than  solve  the  MPLP  (i)  directly,  therefore,  we  note  that 

(k)  , (k) 

the  necessary  multipliers  A.:.  (and  constants  z^-)  can  easily  be 

r J c J 

obtained  as  a by-product  of  the  subproblem  solutions  computed  in  the 

course  of  the  RBBA  Specifically,  suppose  that  at  some  point  in  the 

(k) 

algorithm,  2.  distinct  sets  of  multipliers  . , 1 < i < m}  (k  = 

J u 1 

1,  2,  2 .)  have  been  obtained  in  the  jbb  subproblem,  where 

J 

1 < 2 . < L . A "relaxed"  master  problem  of  the  form  (MP)  can  be  con- 
J J 

structed.  in  which  some  of  the  constraints  (17)  are  omitted.  The  Relaxed 
Master  Problem  is 


subject  to 


L/  z-j  > 

(19) 

N 

Z>  bij  ^ bi 

j=l  J 

1=1,2,. 

. . ,m 

(20) 

l xfkV  <2W 

lj  ij  - Oj  ’ 

k=l,2, . 

• • >2  j=l,2, . . 

-,N  (21) 

< b . . , b . . integer , 
- U ij  0 ’ 

1=1,2, • 

■ • ,m,  j=l»2 , . . 

. ,N  . (22) 

In  considering  the  set  F of  feasible  allocations,  the  optimal 
/ n 

. * ( -i  ) . 

solution  (z.,  bw  ),  j = 1,  2,  ...  , N,  to  (RMP)  provides  a valid 
0 

N * 

upper  bound  U = £)  z . on  the  maximal  objective  value  which  can  be 
j=l  J 

attained  in  (P)  under  any  allocation  in  F • If  F is  not  fathomed 
v „ n n 

(l)  (N)* 

by  U,  the  allocation  (bv  , ...  , bv  ) may  be  used  in  solving  the 


subproblems  in  Step  k of  the  RBBA.  If  any  linear  programming  based  solu- 
tion procedure  is  used  (e.g.,  a branch-and-bound  method  such  as  was 
outlined  in  Section  1.2),  it  is  well-known  that  the  dual  multipliers 


1 < i < m,  appear  in  the  optimal  LP  solution  to  (S.)  as  the  reduced 
J J 

cost  coefficients  associated  with  the  linking  constraint  slack  variables. 

( k) 

Thus,  while  it  may  be  advantageous  to  derive  a few  sets  , 1 < i < m) 

of  multipliers  initially  in  each  subproblem,  remaining  sets  can  be  obtained 

at  little  additional  computational  expense  as  the  search  proceeds.  In 

this  way,  much  of  the  work  involved  in  explicitly  computing  the  functions 

z.(bv  ')  defined  in  (14)  can  be  avoided. 

0 

fk) 

One  procedure  by  which  suitable  initial  sets  of  multipliers  . , 

— 0 

1 < i < m]  may  be  determined  is  begun  by  specifying  an  arbitrary  allo- 

cation  b^  , j = 1,  2,  . . . , N,  in  each  subproblem.  These  b ^ 

should  be  chosen  to  ensure  that  each  of  the  subproblems  (S.)  has  an  LP- 

J 

optimal  solution  which  is  finite,  but  it  is  not  necessary  that  the  overall 
.#  r \* 

allocation  (b  , ...  , b^  ) itself  be  feasible;  that  is,  it  is  not 
necessary  that  the  constraint 


N /,\* 

t b(j)  < b 


be  satisfied.  When  each  of  the  subproblems  is  solved  as  a linear  program, 
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mm+£ 


the  resulting  sets  of  dual-optimal  multipliers  can  be  used  to  construct 
a.  first  relaxed  master  problem,  say  (RMP^) . This  problem  may  in  turn 
be  solved  to  generate  a second  (feasible)  allocation,  thereby  establishing 
an  iterative  routine.  In  particular,  on  the  kth  iteration  (k  = 1,2,...), 
the  subproblems  are  resolved  as  linear  programs,  using  the  optimal  allo- 
cation from  (RMP^) . Any  new  sets  of  multipliers  discovered  in  the  process 
are  used  to  augment  (BMP  ) to  obtain  the  next  relaxed  master  problem 
(RMP^-j  ) . The  procedure  terminates  at  iteration  K when  no  new  sets  of 
multipliers  result  from  the  optimal  allocation  in  (RMP,,) . The  final 

problem  (RMP.  ) then  serves  as  the  initial  relaxed  master  problem  in 
K 

the  RBBA. 

In  many  practical  situations,  a good  starting  allocation 
(b  , ...  , b^1  ) may  be  readily  available  from  previous  experience 


with  the  problem.  If  no  such  allocation  can  be  easily  determined,  however, 
one  may  begin  by  specifying  b^  = b^,  j = 1,  2,  ...  , N,  where 
b^  is  the  initial  vector  of  upper  bounds  on  the  linking  resource  allo- 
cations in  the  j T'^  subproblem.  (Methods  for  computing  b^^  have 

been  presented  in  Section  2.3>)  If  any  subproblem  (S.)  is  then  found 

J 

to  be  infeasible,  it  is  clear  that  the  block  angular  integer  program 
(P)  must  itself  be  infeasible. 


Note  that  z.,  the  optimal  LP  objective  value  in  (S.)  under  t?ie 

j 

/ . \ TV 

allocation  b ^ , must  satisfy 


z . < z . = min 


J ~ J 


1 < k < H . 


<*<*>  ♦ 2 . 

Oj  M ij  ij 


If  equality  holds  in  (23),  the  bound  z.  on  v(S.|b  J ) obtained 

J J 

from  (RMP)  is  as  tight  as  that  which  would  have  been  produced  by  solving 


r 


the  full  Master  Problem  (MP) . If  z.  < z.,  however,  it  follows  by 

J J 


strong  duality  that  (adopting  the  notation  of  Theorem  1 again) 


?(3,p(J)  < „i„  <*'*'  + l k}‘'0  . 


(k) 


m 


(*).* 


1 < k < £ . 

- ~ J 


Oj 


i=l 


ij  ij 


(24) 


The  inequality  (24)  in  turn  implies  that  the  set  of  dual  multipliers 


(V3-) 

(\,,d  , 1 < i < m}  obtained  in  solving  (S.)  is  distinct  from  any  of 

1 J J 

'k) 


the  previous  sets  , l<i<m},  k=  1,  2,  ...  , i..  Moreover, 

i J J 


since 


-(a)  m _ .'V11  i <V«  * 


za  - y'  <>  " zoj 


! 

I 


E 

1 

I 


^ 


this  new  set  of  multipliers  gives  rise  to  precisely  that  (binding)  con- 
straint of  (MP)  which  was  "missing"  from  (RMP).  Thus,  the  new  multipliers 
generated  in  the  course  of  the  RBM  are  in  some  sense  exactly  (and  only) 
those  which  are  most  relevant.  By  the  same  argument,  it  also  seems 
reasonable  to  expect  that  the  iterative  procedure  described  above  will 
indeed  lead  to  suitable  initial  sets  of  multipliers  for  (RMP). 

A second  advantage  in  utilizing  the  relaxed  master  problem  (RMP) 
rather  than  constructing  the  full  master  problem  (MP)  is  that,  in  general, 
(RMP)  has  fewer  constraints  than  does  (MP).  Practical  experience  has 
indicated  that  the  computational  effort  required  to  solve  linear  pro- 
gramming problems  increases  approximately  as  the  cube  of  the  number  of 
functional  constraints.  Since  most  integer  programming  algorithms  are 
based  on  linear  programming  techniques,  it  is  reasonable  to  expect  that 
(RMP)  will  require  less  solution  time  than  would  (MP).  Of  course,  this 
savings  is  obtained  at  the  cost  of  possibly  reduced  fathoming  capabilities 


j 
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in  the  RBBA,  since  the  objective  function  bound  resulting  from  (RMP) 

may  not  be  as  tight  as  that  provided  by  (MR).  However,  since  most 

fathoming  will  tend  to  occur  at  later  stages  in  the  search,  and  since 

(RMP)  may  be  augmented  with  the  relevant  additional  constraints  (17) 

(k) 

as  new  sets  of  multipliers  (\: . , 1 < i < m}  are  discovered  in  the 

course  of  the  search,  the  loss  may  well  be  minimal. 

The  relaxed  master  problem  (RMP)  may  be  solved  by  any  standard 

mixed- integer  programming  algorithm.  Because  the  auxiliary  variables 

z.  are  not  sign-restricted,  however,  the  constraints  (2l)  serve  merely 
d 

to  supply  upper  bounds  on  the  values  which  these  variables  may  assume. 

In  this  sense,  the  only  functional  constraints  which  appear  in  (RMP) 
are  the  linking  constraints  (20) . Consequently,  integer-feasible  solu- 
tions to  (RMP)  are  easily  obtained,  and  this  fact  can  be  exploited  to 
improve  the  overall  efficiency  of  solution. 

In  particular,  consider  the  situation  when  an  enumerative  algorithm 
is  used  to  solve  (RMP)  The  integer  restrictions  on  the  allocation 

variables  b. . are  relaxed,  and  (RMP)  is  first  solved  as  a linear  pro- 
id 


rss  rsj  f -i  \ 

gram.  Let  (z.,  bvo/),  j = 1,  2,  ...  , N,  denote  the  optimal  LP  solution, 
d 

~ ~ ~(i) 

If  each  b. . , 1 < i < m,  1 < j < N,  is  integer-valued,  (2.,  bVd')  is 
i J d 

optimal  for  (RMP) , and  we  are  done.  Otherwise,  however,  let  f ^ . = 

'V  <v 

b..  - [b.  .],  1 < i < m,  1 < j < N,  denote  the  fractional  part  of  b. ., 
ij  id  - ~ ~ ~ id 

and  define 


Then,  for  i = 1,  2, 


N 

u 

d=l 


I.  - (_/  f . . > i = 1>  2,  ...  , m . 

i -L  J 


(25) 
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and  it  follows  that  I.  must  he  an  integer.  Moreover,  by  (25),  since 


N,  it  is  clear  that  0 < I.  < N 


then,  I.  of  the  b 


may  be  arbitrarily  selected  to  be  rounded  up  to 


while  the 


others  are  rounded  down  to  [b.  .].  One  reasonable  criterion  by  which 


to  round  up  is  to  choose  those  b 


to  decide  which  I.  of  the  b 


if  f_  is  among  the  1^  greatest  members 
of  (f..)l<j<») 


otherwise 


the  rounded  solution  b 


constraints  (20)  of  (RMP) 


The  maximal  values  z!  which  each  auxiliary  variable  z.  may  then 

assume  can  be  readily  computed  from  the  constraints  (21) . The  integer- 

feasible  solution  (z!,  b ),  j = 1,  2,  ...  , N,  immediately  provides 

J N 

an  initial  incumbent  solution  for  (RMP)  (with  objective  value  7)  z!), 


which  may  then  be  used  to  enhance  the  power  of  subsequent  fathoming  tests. 
Non-integer  solutions  produced  at  other  nodes  in  the  course  of  solving 
(RMP)  may  be  similarly  rounded  in  the  hope  of  quickly  locating  improved 
integer  feasible  solutions. 

In  limited  preliminary  computational  tests,  this  simple  rounding 


procedure  was  found  to  be  surprisingly  effective.  For  block  angular 
problems  with  all-integer  cost  coefficients  c^  (j  = 1,  2,  ...  , N) 


in  which  case  the  auxiliary  variables  z.  may  be  integer-restricted,  as 

well  in  (RMP)  - the  rounded  LP-optimal  solution  b_!j  was  usually  optimal. 

More  importantly,  with  only  rare  exceptions  it  was  found  that  whenever  the 
* N * 

bound  U = z.  was  sufficient  for  fathoming  a given  subset  F of 

i=l  J n 

J N 

'"V/  _ 

feasible  allocations,  the  bound  U = fa  z-  was  also  sufficient  for 

i-=i  J 

this  purpose.  Consequently,  little  fathoming  power  is  lost  by  terminating 
the  solution  procedure  for  (RMP)  as  soon  as  the  optimal  LP  solution  has 
been  obtained.  If  the  bound  U does  not  fathom  Fn,  the  (integer-feasible) 
allocation  bVd  = (b..,  ...  , b . ),  j = 1,  2,  ...  , N,  given  by  (26) 

J *“y 

may  be  selected  next  for  examination  in  Step  4 of  the  RBBA.  The  compu- 
tational effort  required  to  solve  the  mixed-integer  programming  problem 
(RMP)  is  thereby  reduced  to  little  more  than  solving  its  linear  program- 
ming relaxation. 

Except  for  the  differences  in  solution  procedures,  the  relaxed  master 
problem  (RMP)  is  used  in  the  RBBA  in  exactly  the  same  way  as  is  the  corres- 
ponding master  problem  for  the  single  linking  constraint  case.  Remarks 
analogous  to  those  in  Section  4.3  apply  here  as  well.  In  particular, 
we  note  that  the  objective  function  bound  obtained  by  solving  (RMP)  can 


be  tightened  by  using  the  known  integer  programming  objective  values 
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corresponding  to  any  fixed  subproblem  allocations  b' 


As  before. 


in  considering  a given  subset  of  allocations  F , let 

= ( j | The  allocation  to  subproblem  (S..)  is  fixed  in  F^}  , 

J2  = (j|l  < j < N}  - Jx  . 

By  appropriately  adjusting  the  right-hand  sides  in  the  constraints  (20) 
of  (RMP),  the  variables  (z . , b^),  j e J-, , may  be  dropped  from  the 
problem,  together  with  the  corresponding  constraints  (21).  The  resulting 
(reduced)  problem, 


maximize 


subject  to 


.2  bij  - bi  ' .2  bij ’ 1 - lf  2’  ’ m 


z.  - £ ^k)b..  <ZW 

J i=l  1J  1J  ~ 0j 


, k - 1,  2,  ...  , , j c Jg 


b.  . < b. . < b. .,  b. . integer  , i = 1,  2,  . . . , m,  j e J_  , 

-lj  - ij  - ij  ij  - 2 ’ 


is  computationally  less  expensive  to  solve  than  the  full  problem  (RMP) 

itself.  The  maximal  objective  value  which  (p)  can  attain  over  the  set 

F can  then  be  bounded  by 
n 


U = £ v(S  |b(j)  ) + £ z*  . 


Alternatively,  if  the  solution  of  problem  (27)  is  terminated  after  the 

LP-optimal  solution  (z.,  b^),  j e J , is  obtained  (as  suggested 

tJ 

above),  we  have 


Decomposition  Algorithm  for  the  Block.  Angular  Integer  Program  (p) 


Phase  1:  Construction  of  Master  Problem 


Step  0.  Input  problem  data.  Compute  upper  and  lower  bounds  b 


on  the  allocation  variables  b 


subproblem 


If  (P)  has  only  a single  linking  constraint,  go  to  Step  1.  Otherwise 


Step  1.  (Single  linking  constraint.)  For  j = 1,  2,  ...  , N,  solve 

subproblem  (S.)  as  a linear  program  parametrically  in  the  amount  b. 

J J 

of  the  linking  resource  allocated  to  (S.),  b.  < b.  < b..  Modify  the 

0 J 0 0 

resulting  parametric  functions  z.(b.)  to  eliminate  non-integer  break' 


points.  Go  to  Phase  2,  Step  0 


Step  2.  (Multiple  linking  constraints.)  Set  0,  j = 1,  2 


If  an  allocation  (b 


known  for  which  each  subproblem  has  a finite  LP-optimal  solution,  set 


1 < j < N.  Otherwise,  set  b 


Step  3-  If  j > N,  go  to  Step  6.  Otherwise,  solve  subproblem  (S.) 


as  a linear  program,  using  the  allocation  b 


in  the  linking 


constraints 


be  the  (m+m .) -vector  of  optimal  dual  multipliers 


, as  obtained  in  Step  3-  It  no  finite  optimal  y 


some 


APS  BLANK- NOT  FILMED 


PRECEDING 


then  reset 


:( j)B(J) 

m+ipi 


Step  0.  Otherwise,  solve  the  linear 


programming  relaxation  of  (RMP),  using  multipliers 


ponding  constants  z 


construct  the  constraints  (21).  For  any  1 < j < N such  that  i.  = 0 


to  the  LP-optimal  solution  to  (RMP).  Reset  n = 0,  j = 1,  and  go  to 


Phase  2:  Search  for  Optimal  Allocation 


Step  0.  If  an  integer  solution  to  (P)  is  known  a_  priori,  set  z equal 


to  its  objective  value  and  store  the  solution  as  the  current  incumbent 


Otherwis 


Step  1.  If  the  list  of  stored  subsets  F,  is  empty,  stop;  the  current 


incumbent  solution  is  optimal  (if  none  has  been  found,  (p)  is  infeasible.) 


Otherwise,  select  the  last  subset  F on  the  list  as  the  next  one  to  be 


examined  Update  the  allocation  variable  bounds  b 


appropriately 


to  correspond  to  those  defining  the  subset  of  feasible  allocations  F, 


Correspondingly,  update  the  sets  J 


if  the  allocation 


reset 


to  subproblem  (S.)  was  fixed  previously,  but  is  not  fixed  in  F , 
J n 

J,  = J,  - (j),  J?  = J„:J  (j).  Go  to  Step  2. 


Step  2.  (a)  Single  Linking  Constraint.  Solve  the  concave-separable 

master  problem  (MP)  (see  Sections  4.1,  4.2),  using  the  current  bounds 
— * * 

b.,  b..  Set  (b  , ...  , b J equal  to  the  optimal  integer  solution.  Set 
J J 

U = J)  v(S.|b*)  + £ z.(b*)  , 

d€Jx  J J jeJ2  J J 

and  go  to  Step  3. 

(b)  Multiple  Linking  Constraints.  Using  the  multipliers 

(\^,  1 < i < m]  and  corresponding  constants  (k  = 1,  2,  ...  , £., 

Oj  j 

j e Jp),  construct  the  relaxed  master  problem  (27).  For  any  j e 
for  which  i = 0,  use  z^V  = + \{V  = 0,  1 < i < m,  in  (27).  For 

j e J?,  set  (z.,  b^)  equal  to  the  optimal  LP  solution,  and  set 

u=  E v(sJb('])  ) + £ z , 

ieJ1  J jeJ2  J 

/ . \* 

where  b J , j e J^,  is  the  current  level  at  which  the  allocation  to 

(S.)  is  fixed.  Go  to  Step  3- 
J 


Step  3-  (a)  Single  Linking  Constraint.  If  U < z , go  to  Step  1. 

Otherwise,  go  to  Step  4. 

(b)  Multiple  Linking  Constraints.  If  U < z* , go  to  Step  1. 

1 ) ( 1 ) 
Otherwise,  round  the  allocations  bv  , j e Jg,  as  in  (26),  and  set  b'J' 

j e J2,  equal  to  the  resulting  integer-feasible  values.  Go  to  Step  4. 

Step  4.  Compare  the  current  allocations  b^  with  the  stored  list 

f i ) ’ 

of  previously  examined  allocations  bVtJ/  (if  any)  in  subproblem  (S.), 

(j0)’  ^o)f  ^o),J 

j e Jp.  If  some  jQ  e yields  b - s < b u < b u 


(V  u0y 

(where  b - s represents  the  level  of  linking  resources  used 

(jj ' 

in  the  optimal  solution  to  (S.  ) under  the  allocation  b u ),  then 

(30)*  (3q)*  (30)'°  (j0)' 

set  s =b  - (b  -s  ) and  go  to  Step  10.  Otherwise, 

go  to  Step  5 • 


Step  5.  Select  a subproblem  (S.  ),  j e J„,  by  either— 

J0  ° d 


(i)  j = min(j | j e Jg}j  or 


(ii)  = arg  min  T.,  where  T.  is  the  average  solution  time  for 

3 e J2  J J 

(S.)  observed  in  the  previous  solutions  of 
J 

of  (S.)  in  Phase  2:  or 
v 0 * 

(iii)  j = arg  max  G.,  where  G.  is  the  average  gap  between  the  LP 

3 6 J2  J J (i)* 

bound  z.(bv  ) obtained  in  Step  2 and  the 
D 

actual  corresponding  integer-programming  value 

, .N* 

v(S.|b  ^ ) for  (S.)  observed  in  the  previous 

J J 

solutions  of  (Sj)  in  Phase  2;  or 


(iv)  j = arg  max  X.,  where  X.  is  the  average  sum-of-slacks 

•)  € J2  J m ,J 


£ s!J) 


observed  in  the  linking  constraints 


in  previous  solutions  of  (S.)  in  Phase  2. 

J 


Then  go  to  Step  6. 


The  notation  j = arg  min  T.  (arg  max  G.,  arg  max  X.)  is  used  to 


j € JV 


J € J n 


j € Jr 


indicate  that  the  index  i_  is  to  be  chosen  so  that  T.  = min  T. 

0 .i  . i 

"0  j€J2  J 

(G.  = max  G.,  X.  = max  xj. 

J0  jeJr  0 i 


J0  jeJ. 
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MMfM Rn>  v.f  ■ 


Step  6.  Compare  the  current  allocation  b 


(j0}1 


with  the  stored  list 


of  previously  determined  levels  of  optimal  linking  resource  usage  b 

(jj* 

- s in  (S . ) • Let  B = (b 

J0 


<V’  <V  >b<v  _<v 


- s 


<V’ 


},  and  set 


i (V 

z = max  v(S.  |b  ) . 

(Jn)’  Jo 

b u eB 


If  B = i,  set  z = - oo.  Go  to  Step  7. 


Step  7.  Solve  (S.  ) using  the  allocation  b 


(jn)' 


If  a branch-and-bound 


method  is  used,  the  value  of  z computed  in  Step  6 provides  an  initial 


lower  bound  on  the  optimal  objective  value.  Then, 

(J0)* 

(i)  If  (S.  ) is  infeasible,  set  s = + °°,  z. 

J0  J0 
to  Step  9* 


and  go 


(ii)  If  there  exists  a finite  optimal  solution  x 


qj 

to  (S.  ), 

(d0)*  (V*  (V*  * (jo}  ° 

set  s = b - A x and  z . = c x 

J0 

If  m = 1 (single  linking  constraint  case),  go  to  Step  9.  If 
m > 1,  go  to  Step  8. 

(iii)  If  (S.  ) is  feasible,  but  the  optimal  solution  is  unbounded, 

J°  * 

(O0) 

let  x be  an  endpoint  of  the  ray  generating  the  unbounded 

(dJ*  (i  f (jJ  (Jj* 

solution,  and  set  s = b -Ax  . (See  dis- 

. * 

cussion  below.)  Set  z.  = + 00 , Go  to  Step  9* 

J0 

_(  Jq) 

Step  8.  (Used  in  multiple  linking  constraint  case  only.)  Let  y 
be  the  (m+m.  )-vector  of  LP-optimal  dual  multipliers  for  (S.  ) under 

J°  (j/  3° 

the  allocation  b (as  determined  in  Step  7)-  If  for  some 


, 
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* « 1,  2, 


' V 

m . 

io  JiQ)  (J0) 

J)  y 0 p.  0 

Jm+i  x 

i=l 


(k)  . -(jo}  ,(k) 

°j0  v 


1 < i < m , 


go  to  Step  9*  Otherwise,  reset  i.  = l.  +1,  and  set 

J J 


( 0 > ^4 

d0  v?  bVTV 


‘V 


- S y„+i  P1  - ana  v.  - n - 1 i 1 < " • 


J0  i=l 


Then  go  to  Step  9* 


Step  9-  Add  b to  the  list  of  examined  allocations.  Correspond- 

ent e0)*  * , (o0)* 

ingly,  add  b - s and  z.  = v(S.|b  ) to  the  lists  of 

d0  J 

optimal  linking  resource  usage  levels  and  associated  objective  values, 
respectively.  Go  to  Step  10. 


Step  10.  If  |jn|  < 1,  go  to  Step  11.  Otherwise,  branch  on  the  alio 

Tjj 

cation  variables  b as  described  in  Chapter  J.  (See  especially 

Figure  2 of  Chapter  J>.)  Add  each  of  the  newly  formed  subsets  F,  to 

K 

■X-  Xr 

the  list  of  such  subsets.  If  b..  >b..  -s..  for  some  1 < i < m 

-u0  ^0  1Jo  “ " 

(d0)  (dJ  (d 

go  to  Step  1.  Otherwise,  revise  the  bounds  on  b to  b = b 

(j0)*  JV  (V*  1/ 

- s , b = b ,-  and  reset  = Ji  U J2  = J2  " 

(The  allocation  in  subproblem  (s.  ) is  then  temporarily  fixed  at  the 

(d0)  (J0)*  (J0)*  J° 

level  b = b - s . ) Go  to  Step  2. 


17 

— If  in  Step  4 of  Phase  2 it  was  discovered  that  b - s 

(J0)*  ( Jq) ’ (d0)’ 

b < b for  some  previously  examined  allocation  b , it 

_(d0)  _(d0)  (d0)’  (d0)* 

will  be  more  efficient  to  reset  b = min(b  ,b  ) > b 


imwirM  im.  mm 


■MMMM 


N * * * N * 
Step  11.  If  J)  z.  < z , go  to  Step  1.  Otherwise,  reset  z = £ z.,, 

j=i  3 “ # J-l  ° 

and  install  (x^  , , x^  ) as  the  new  incumbent  solution;  then 

go  to  Step  1. 

The  (optional)  Steps  4,  6,  9 in  Phase  2 of  the  decomposition  algorithm 


can  improve  algorithmic  efficiency  in  the  following  ways.  In  Step  4,  if 

(jQy  (oQy  (j0}* 

b - s < b < b , the  solution  which  was  optimal  for 

(jQ)  (jQ) ' 

(S.  ) under  the  allocation  b = b must  also  be  optimal  for  the 

° (V  (J0>* 

current  allocation  b = b .In  this  case,  therefore,  the  work 

to  resolve  (S.  ) can  be  avoided,  and  instead  we  can  jump  immediately  to 
J0 

the  branching  step  (Step  10).  Branching  on  the  allocation  variables 

(J0)  . , 

b is  done  in  exactly  the  same  way  as  if  (S.  ) had  been  resolved 

(30>  tJ0)' 

explicitly  under  the  allocation  b =b 

At  Step  6 in  Phase  2,  when  the  subproblem  (S . ) must  be  resolved 

J°  , (V* 

explicitly,  the  validity  of  the  lower  bound  £ on  v(S.  |b  ) follows 


(Jj 


(jo) 


i 0 v 0 

from  the  observation  that  v(s.  |b  ) must  be  nondecreasing  in  b 


If  a branch-and-bound  search  procedure  is  used  to  solve  (s.  ) in  Step  7> 

J0 

the  lower  bound  z is  immediately  available  for  use  in  fathoming  tests, 
and  can  thereby  reduce  the  total  computational  effort  of  solution.  How- 
ever, in  general,  any  subproblem  solution  method  may  be  used  in  Step  7 
in  the  single  linking  constraint  case,  and  any  method  yielding  the  LP- 
optimal  dual  multipliers  y as  a by-product  of  the  solution  may  be 

used  in  the  multiple  linking  constraint  case.  If  the  method  chosen  for 
subproblem  solution  is  not  of  the  branch-and-bound  type,  it  may  be  more 


efficient  to  omit  Step  6 in  Phase  2. 
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integer-feasible  allo- 
cation  bVd ' f ' 


(jeJg). 


/Compare  bVJ/  with  pre-  \ 
^viously  examined  allocations  \ 

(*\,  (V 

J in  (Sj).  Is  b -s  / 

\ (V’  / 

\<  b u < b u for  / 

\ some  JQ  e J2?  / 


Figure  2a:  Flow  diagram  for  Phase  2 of  the  decomposition  algorithm  (continued  in  Figure  2b) 


B 


Select  a subproblem  (S.  ), 


Compute  init.  lower  bound  on 

OJ* 

v(S  . |b  ). 


SLC  Solve  (S.  ) with  allocation 

* 

(jo)  ^0 

b = b 


Finite  LP-opt.  sol. 
obtained? 


Store  dual  optimal  multi- 
pliers if  distinct  from 
previous  multipliers. 
Update  i.  accordingly. 

^0 


Store  solution  data: 

(V*  <v*  <v* 

b ,b  -s  , 

. (V* 

v(S  |b  0 ). 

Jo 


|J2I  11? 


3ranch  on  b 
Jpdate  J^,  Jg. 


If  £v(S  |b^  )> 
j=l  J 
* N 

reset  z = £ v(S.|b^  ), 

J-l  J 

and  install  current  sol. 
as  new  incumbent. 


?5 


Of  course,  the  computational  savings  resulting  from  Steps  4 and  6 
are  obtained  at  the  expense  of  increased  storage  requirements.  The 
necessary  data  storage  is  performed  in  Step  9 of  the  algorithm.  Some 
savings  of  storage  space  is  possible  by  noting  that  if  for  some  previous 


allocation  b 


<V 


(jQ)  (Jq)  ^0^'  (d0}  ^0^ 

b - s = b - s and  b > b , 

(V*  (V*  (V 

then  the  new  data  b , b - s may  replace  b , 

<j0>-  (jj*  , <V*  , 

b - s in  storage.  (Since  v(S.  |b  ) = v(S.  |b  ) 

„ J0  J0 

, (j0} 

in  this  case,  v(S.  |b  ) need  not  be  rewritten.) 

J0 

Four  different  heuristic  procedures  for  subproblem  selection  are 
suggested  in  Step  5 of  Phase  2.  Of  these,  the  first  has  the  advantage 
that  it  is  clearly  least  expensive  computationally.  Rule  (ii),  however, 
can  be  more  effective  in  practice,  especially  if  some  subproblems  require 
significantly  longer  solution  times  than  others  (e.g.,  if  some  subproblems 
are  much  larger  than  others).  By  solving  the  easier  subproblems  first 
(at  which  point  it  becomes  possible  to  use  the  exact  integer  programming 
objective  values  for  these  subproblems  in  computing  the  bound  U in 
Step  2),  fathoming  will  often  occur  before  it  becomes  necessary  to  solve 
the  more  difficult  subproblems. 

On  the  other  hand,  the  easiest  subproblems  to  solve  do  not  always 
provide  the  most  information  for  subsequent  use  in  the  decomposition 
algorithm.  The  motivation  for  rule  (iii)  is  that  selecting  the  subprobleo 

(j0)  . (JJ 

(S.  ) (j  € J ) for  which  the  average  gap,  z (b  ) - v(S.  |b  ), 

J0  U d J0  J0 
is  greatest  may  lead  to  the  best  improvement  in  the  tightness  of  the  bound 
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U computed  in  Step  2 at  the  next  iteration.  The  hope  is,  of  course, 
that  by  enhancing  the  power  of  the  fathoming  test  in  Step  3,  the  total 
number  of  subproblem  solutions  required  in  the  course  of  the  search  will 
be  reduced.  Alternatively,  the  use  of  rule  (iv)  in  Step  5 can  lead  to 
the  greatest  inprovement  in  the  allocations  generated  in  Step  3 of  the 
algorithm;  following  the  solution  of  (S.  ) in  Step  7 and  subsequent 

(V* 

branching  in  Step  10,  the  slacks  s are  reallocated  to  the  remaining 

unfixed  sub problems  in  Step  3*  Hence,  it  also  would  seem  reasonable  to 

solve  first  those  subproblems  (S.)  which  consistently  give  rise  to  the 

* ^ 

largest  values  of  s'J 

Preliminary  experimentation  has  indicated  that  the  selection  rules 
based  on  subproblem  solution  times  (rule  (ii))  and  average  gaps  between 
the  subproblems'  linear  and  integer  programming  objective  values  (rule 
(iii))  may  be  the  most  advantageous  in  practice.  Of  these  two,  rule 
(iii)  appeared  to  be  more  consistently  effective.  However,  inasmuch  as 
the  subproblems  in  the  test  problems  run  were  all  of  equal  size,  it  is 
conceivable  that  rule  (ii)  may  indeed  be  more  favorable  when  the  differ- 
ences in  subproblem  solution  times  are  more  dramatic.  Similarly,  while 
rule  (iv)  was  found  to  be  little  more  effective  than  the  rather  arbitrary 
selection  rule  (i)  (and  sometimes  much  less  effective),  it  should  be 
pointed  out  that  subproblem  linking  constraint  coefficients  were  of 

approximately  equal  magnitude  in  all  test  problems  run.  Consequently, 

. *. 

the  resulting  optimal  slacks  s'J  tended  to  be  of  equal  magnitude 
for  all  subproblems. 

For  completeness,  it  is  necessary  in  Step  7 of  Phase  2 of  the  decom- 
position algorithm  to  consider  the  situation  when  the  subproblem  (S.  ) 

°0 
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is  found  to  have  an  unbounded  optimal  solution.  Hence,  let 


X(bUo)  ) • (xUoVJo>*(3o)  <b(Jo)  , B<3o)x(3°’  <p(Jo>, 

(d0)  (dJ 

x > 0,  x integral}  . 

(dQ) 

Kaneko  (197*0  has  shown  that  whenever  the  entries  of  the  matrices  A , 

(d0>  (Jo}* 

B ) are  rational,  the  unboundedness  of  X(b  ) implies  the  existence 

/ ,* 

(d0) 

of  a "discrete  ray"  RC.X(b  ),  where 


(jj,  (d0)  (d0f 

R = (x  0 |x  0 = x 0 + 0d,  0 e i}  , 

, /X* 

(d0)  (d0) 

and  where  x e X(b  ),  the  n.  -vector  d ^ 0,  and  I is  an 

J0 

infinite  subset  of  the  set  of  nonnegative  numbers.  Ideally,  one  wquld 

cv* 

like  to  choose  the  endpoint  x in  part  (iii)  of  Step  7 to  make 

/ x*  /x*  /xxx* 

(j0>  U0>  (J0)  (J0) 

each  component  of  the  slack- vector  s =b  -Ax  as 

large  as  possible,  in  the  hope  of  subsequently  improving  the  allocations 
to  the  remaining  subproblems.  However,  the  difficulty  of  determining 
an  appropriate  endpoint  for  this  purpose  may  well  be  prohibitive,  and 

(j0} 

for  our  purposes  any  integer-feasible  endpoint  x e R will  suffice. 

Finally,  we  remark  that  it  is  easy  to  see  that  if  > 1 for  all 
1 < j < N at  the  end  of  Phase  1 in  the  multiple  linking  constraint  case, 
then  the  initial  relaxed  master  problem  (RMP)  in  Phase  2 is  sufficient 
for  solving  the  block  angular  linear  programming  problem  associated 
with  (P).  Specifically,  the  first  allocation  (b^,  ...  , b^) 
obtained  in  Step  2 of  Phase  2 of  the  decomposition  algorithm  must  lead 
to  the  overall  optimal  LP-solution  to  (p)  when  each  subproblem  (S.) 

J 
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is  solved  as  a linear  program  under  the  vector  of  linking  constraint 
right-hand  sides  b'  , j = 1,  2,  ...  , N.  Similarly,  the  Phase  1 pro- 
cedure in  the  single  linking  constraint  case  solves  the  corresponding 
linear  programming  relaxation  of  (P),  provided  the  parametric  functions 

z.(b.)  are  not  modified  to  eliminate  non-integer  breakpoints. 

J J 

5-3  Possible  Modifications  to  the  Algorithm 

There  are  several  possible  modifications  to  the  decomposition  algorithm 
which  may  merit  further  investigation.  It  may  be  computationally  more 
efficient,  for  example,  not  to  resolve  the  Master  Problem  after  every 
subproblem  solution.^  Instead,  after  a given  subproblem  is  solved, 
the  slacks  associated  with  the  linking  constraints  can  be  arbitrarily 
reallocated  to  the  remaining  (unfixed)  subproblems.  One  possible  heur- 
istic reallocation  procedure  that  would  be  computationally  less  expensive 
is  simply  to  assign  all  slacks  to  the  next  subproblem  to  be  solved. 

The  Master  Problem  must  at  least  be  resolved  periodically,  of  course, 
to  test  for  fathoming  and  to  identify  promising  new  allocations  when 
fathoming  does  not  occur.  Consequently,  some  computational  experimen- 
tation with  various  (possibly  dynamic)  decision  rules  governing  the 
frequency  of  Master  Problem  reoptimization  would  be  necessary.  The 
decision  not  to  resolve  the  Master  Problem  at  every  node  in  the  search 
tree  inevitably  results  in  the  loss  of  fathoming  capabilities  at  the 
"skipped"  nodes,  so  that  some  of  the  computational  savings  obtained  in 
by-passing  the  Master  Problem  may  be  lost  in  examining  nodes  which  would 


— Since  the  special  structure  of  the  Master  Problem  in  the  single  linking 
constraint  case  gives  rise  to  the  efficient  solution  procedure  developed 
in  Chapter  k,  this  modification  is  perhaps  more  relevant  for  the  multiple 
linking  constraints  case. 
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otherwise  have  been  fathomed.  However,  especially  in  large  block  angular 
problems,  where  fathoming  is  likely  to  occur  only  after  many  subproblems 
have  been  solved,  the  loss  may  well  be  minimal. 

Secondly,  it  is  not  strictly  necessary  to  branch  on  the  corresponding 
allocation  variables  immediately  after  each  subproblem  is  solved.  An 
alternative  strategy  would  be  to  successively  reallocate  any  slacks 
appearing  in  the  linking  constraints  in  each  subproblem  solution  (as 
is  currently  done),  but  to  postpone  branching  until  all  subproblems 
have  been  solved,  or  until  the  current  allocation  can  be  recognized  as 
being  suboptimal.  At  this  point,  one  subproblem  may  be  chosen,  and  the 
corresponding  allocation  variables  branched  on  in  the  usual  way. 

This  approach  would  allow  greater  flexibility  in  the  order  in  which 
the  branching  variables  are  selected.  Concomitant  with  such  an  approach, 
therefore,  might  be  the  development  of  procedures  for  computing  "penalties" 
associated  with  the  branching  process.  These  penalties,  in  analogy  with 
those  used  in  standard  (nondecomposition)  branch-and-bound  algorithms, 
could  be  used  to  guide  branch  selection,  and  to  tighten  the  objective 
function  bounds  associated  with  the  stored  nodes. 
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CHAPTER  6 

COMPUTATIONAL  RESULTS 


Evaluation  of  the  decomposition  algorithm  presented  in  Section  5.2 
was  carried  out  on  Stanford  University's  IBM  370/ l68  computer,  using 
programs  written  in  FORTRAN  IV  by  the  author.  In  particular,  a branch- 
anl-Uoun  1 procedure  for  the  general  integer  programming  problem,  and 
two  versions  of  the  algorithm  for  decomposing  block  angular  integer 
programs  (corresponding  to  the  single  and  multiple  linking  constraint 
cases,  respectively)  were  coded. 

The  branch-and-bound  code  was  written  for  use  in  generating  the 
subproblem  solutions  required  in  Step  7 of  Phase  2 of  the  decomposition 
procedures.  In  addition,  this  code  also  served  to  provide  a guideline 
for  evaluating  the  practical  effectiveness  of  the  decomposition  algorithm, 
in  that  the  test  results  obtained  by  the  latter  can  be  compared  to  those 
which  might  be  obtained  by  a nonde composition  approach  to  the  same  problems. 
The  decision,  specifically,  to  implement  a branch-and-bound  routine  for 
this  dual  puipose  was  made  in  consideration  of  the  fact,  that  branch- 
and-bound  algorithms  appear  to  be  the  most  consistently  effective  of 
the  various  types  of  general  integer  programming  procedures. 

The  branch-and-bound  routine  coded  is  based  on  the  algorithm 
suggested  by  Dakin  (1965).  Tomlin’s  (1970)  improved,  penalties  are  used 
to  enhance  the  power  of  fathoming  tests  at  each  node,  and  to  guide  branch 
selection  at  un fathomed  nodes.  Specifically,  the  branching  variable 
is  always  chosen  to  be  the  variable  with  the  largest  associated  up-  or 
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down-penalty,  and  the  forward  branch  is  made  in  the  direction  opposite 


to  the  maximum  penalty.  The  node  generated  by  the  branch  in  the  same 


direction  as  the  maximum  penalty  is  added  to  the  list  to  be  examined 


later.  This  branching  strategy  was  first  adopted  by  Little,  Murty, 


Sweeney,  and  Karel  (19 63),  and  has  since  enjoyed  considerable  success. 


(See,  for  example,  Beale  and  Small  (1965).)  Stored  nodes  are  retrieved 


from  the  list  in  accordance  with  the  last-in-first-out  (LIFO)  rule. 


(See  Section  2.2.)  For  more  details,  the  interested  reader  is  referred 


to  the  references  above,  and  also  to  Beale  (1968). 


The  primal- simplex  code  LPM-1  was  used  to  form  the  linear  programming 


foundation  for  our  three  programs.  This  code  uses  the  product-form  of 


the  inverse,  and  was  developed  by  J.  A.  Tomlin  of  the  Systems  Optimi- 


zation Laboratory,  department  of  Operations  Research,  Stanford  University, 


In  order  to  use  LPM-1  within  the  context  of  a branch-and-bound  procedure, 


the  program  was  modified  to  handle  variables  with  general  upper  and 


lower  bounds,  and  appropriate  row  and  column  selection  subroutines  were 


added  to  facilitate  operation  as  a dual-simplex  method  as  well.  Reopti- 


mization following  a branch  in  the  forward  direction  is  carried  out  by 


dual-simplex  pivots,  while  primal-simplex  pivoting  is  used  for  reopti- 


mization when  backtracking  to  examine  a previously  stored  node.  The 


LPM-1  code  is  also  used  to  solve  the  relaxed  master  problem  (RMP)  in 


the  decomposition  program  written  for  the  multiple  linking  constraints 


case.  The  fact  that  some  of  the  variables  in  (RMP)  are  not  sign  restricted 


presents  no  additional  difficulties,  since  LPM-1  has  been  modified  to 


treat  variables  with  general  upper  and  lower  bounds. 


The  remaining  portions  of  the  codes  were  written  in  modular  form 


according  to  the  various  tasks  to  be  performed  (e.g.,  branching,  penalty 


calculation,  fathoming  tests,  etc.,  for  the  branch-and-bound  code;  master 
problem  construction,  master  problem  solution,  branching  on  the  allo- 
cation variables,  etc.,  for  the  decomposition  codes).  The  final  version 
of  the  branch-and-bcund  code  was  compiled  under  the  IBM  FORTRAN-H-Extended 
compiler,  using  the  optimization  option  at  level  two.  While  dimensioned 
to  treat  general  integer  programming  problems  with  as  many  as  2000  non- 
zero constraint  coefficients,  the  object  program  is  approximately  1x3  K 
bytes  in  length.  The  similarly  compiled  final  version  of  the  decompo- 
sition procedure  in  the  single  linking  constraint  case,  dimensioned  to 
handle  up  to  ten  subproblems  with  a total  of  as  many  as  1000  nonzero 
constraint  coefficients,  is  approximately  125  K bytes  in  length.  For 
both  programs,  all  instructions  and  data  are  in-core.  While  a code  for 
the  decomposition  of  block  angular  integer  programs  ith  multiple  linking 
constraints  was  developed  and  debugged  under  the  WATFIV  compiler,  no 
object  code  was  generated  for  this  program.  The  test  results  reported 
below  are  for  the  single  linking  constraint  case  only. 

While  the  author  does  not  claim  the  expertise  of  a professional 
programmer,  it  is  hoped  that  by  writing  these  codes  himself,  and  by 
using  the  same  branch-and-bound  integer  programming  procedure  throughout, 
the  effects  of  discrepancies  in  programming  sophistication  on  test  results 
will  be  mitigated.  Nonetheless,  the  results  reported  here  should  not 
necessarily  be  considered  representative  of  those  which  might  be  obtained 
by  professionally  developed  codes. 

6.1  The  Testing  Procedure 

There  are  several  parameters  which  can  affect  the  performance  of 
the  decomposition  algorithm,  including  linking  constraint  tightness, 
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overall  problem  size,  subproblem  size,  the  number  of  linking  constraints, 
etc.  As  limitations  on  time  and  computer  funds  prohibited  the  detailed 
examination  of  all  such  parameters,  however,  it  was  decided  to  restrict 
the  computational  testing  of  the  algorithm  primarily  to  study  the  effects 
of  linking  constraint  tightness  and  overall  problem  size. 

In  order  to  test  the  effects  of  linking  constraint  tightness  on 
solution  times,  some  control  over  the  tightness  of  all  the  constraints 
must  be  established.  To  accomplish  this,  in  each  test  problem  the 
coefficients  in  each  subproblem  constraint  row  were  summed,  and  the  right- 
hand  side  (RHS ) for  that  row  was  set  to  a given  multiple  of  the  sum. 

Thus,  in  the  notation  used  in  the  following  sections,  RHS  = 300$  (500$) 
indicates  that  the  right-hand  side  in  each  of  the  subproblem  constraints 
was  set  equal  to  3 (5)  times  the  sum  of  the  coefficients  in  the  corres- 
ponding row. 

Once  the  right-hand  sides  in  the  subproblem  constraints  were  fixed, 
the  right-hand  side  for  the  linking  constraint  was  similarly  set  equal 
to  a given  multiple  of  the  sum  of  linking  constraint  coefficients.  By 
varying  this  multiple  with  RHS  fixed,  the  relative  tightness  of  the 
linking  constraint  can  be  varied. 

Definition:  Let  the  right-hand  sides  of  the  subproblem  constraints  be 

fixed  at  a given  multiple,  say  k^,  of  the  sum  of  constraint  coeffi- 
cients. Then,  if  the  right-hand  side  in  the  linking  constraint  is  set 
to  k2  times  the  sum  of  linking  constraint  coefficients,  the  tightness 
ratio  TR  is 

TR  = kg/^  . 
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linking  constraint  tightness  in  the  computational  results  reported  below 


the  smaller  the  value  of  TR,  the  tighter  is  the  linking  constraint 


relative  to  the  subproblem  constraints.  Reasoning  very  intuitively,  one 


might  expect  that  the  performance  of  the  decomposition  algorithm  would 


improve  relative  to  that  of  a nondecomposition  approach  as  TR  is  in 


creased.  If  the  linking  constraint  is  so  tight  that  the  subproblem 
constraints  are  redundant,  the  problem  (p)  is  not  really  a block  angular 


integer  program  at  all,  but  in  effect  has  been  tricked  into  taking  on 


a block  angular  appearance  by  the  addition  of  redundant  subproblems 


Consequently,  there  would  seem  to  be  little  advantage  in  using  the 


decomposition  procedure.  At  the  other  extreme,  if  TR  is  so  large 


that  the  linking  constraint  is  redundant,  (P)  consists  of  N independent 


problems  which  have  been  artificially  forced  together  into  one.  In 


this  case,  the  decomposition  approach  should  be  highly  efficient!  The 


purpose  in  examining  the  effects  of  linking  constraint  tightness,  there 


fore,  was  to  test  the  validity  of  this  conjecture,  and,  if  valid,  to 


try  to  distinguish  the  ranges  of  TR  in  which  each  of  the  two  approaches 


The  method  used  to  test  the  effects  of  overall  problem  size  on 


solution  times  is  similar  to  the  method  reported  by  Reardon  (197*0  • 

Once  a given  block  angular  integer  program  (P)  was  formulated  (with,  say, 
N subproblems  in  all),  derivative  problems  with  2,  4,  6,  ...  , N sub- 


problems were  obtained  by  deleting  various  numbers  of  the  subproblems  of 


Consequently,  the  derivative  problems  retained  many  of  the  char 


acteristics  of  the  source  problem,  and  so  were  closely  related  in  terms 


of  their  degree  of  computational  difficulty.  As  Reardon  pointed  out. 


this  relationship  enables  the  direct  comparison  of  solution  times  for 
problems  of  increasing  size,  since  differences  in  solution  times  may 
be  attributed  largely  to  the  size  differences  alone. 

In  all,  four  test  problems  and  their  derivatives  were  solved.  The 
data  for  the  first  two  problems  was  obtained  from  a test  problem  of 
Reardon’s,  and  attention  was  concentrated  on  the  effects  on  solution 
times  of  various  levels  of  linking  constraint  tightness  in  these  problems. 
The  data  for  the  third  test  problem  was  taken  from  a capital  budgeting 
application  reported  by  Fleisher  (1976).  For  this  problem,  both  the 
effects  of  linking  constraint  tightness  and  problem  size  were  investi- 
gated in  turn.  In  the  fourth  problem,  the  data  originated  from  an  R & D 
project  selection  problem  given  by  Petersen  (1967)-  The  primary  objective 
in  this  case  was  to  observe  the  dependence  of  solution  times  on  problem 
size.  In  addition,  for  both  the  third  and  fourth  test  problems,  internal 
timers  were  added  to  the  two  codes  to  monitor  the  progress  of  the  solution 
with  computation  time.  In  particular,  whenever  a new  incumbent  solution 
was  found,  the  objective  value  of  the  solution  and  the  computation  time 
required  to  reach  that  solution  were  printed  out.  This  information 
provides  insight  into  the  effectiveness  of  the  decomposition  algorithm 
as  a heuristic  procedure  for  quickly  generating  good,  though  possibly 
nonoptimal,  solutions  for  block  angular  problems  which  may  be  too  large 
to  solve  optimally. 

6.2  Test  Problems  1 and  2 

The  first  two  test  problems  consisted  essentially  of  subproblems 
one  through  four  and  sub problems  five  through  eight,  respectively,  of 
Reardon's  test  problem  number  one.  The  original  data  for  this  problem 
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was  derived  from  Petersen's  B & D project  selection  problem  5*  Reardon 
transformed  the  data  appropriately  to  obtain  an  integer  programming 
problem  with  the  dual  angular  structure.  By  taking  the  transpose  of  the 
first  linking  column  in  Reardon's  problem  as  the  single  linking  constraint 
in  ours,  and  dropping  the  remaining  linking  columns,  we  obtained  a problem 
with  the  block  angular  structure  suitable  for  use  in  testing  the  decompo- 
sition algorithm.  Since  the  primary  interest  initially  was  in  the  per- 
formance of  the  decomposition  algorithm  in  relation  to  the  degree  of 
linking  constraint  tightness,  rather  than  problem  size,  the  problem  was 
arbitrarily  divided  into  the  two  smaller  test  problems  of  four  subproblems 
each.  The  savings  in  computation  time  which  resulted  from  this  reduction 
enabled  more  extensive  testing  of  the  effects  of  linking  constraint 
tightness  than  would  otherwise  have  been  possible. 

Inasmuch  as  each  of  the  subproblem  constraint  matrices  consisted 
of  five  rows  and  five  columns,  both  Test  Problems  1 and  2 were  21-row, 
20-variable  integer  programs  overall.  These  problems  are  exhibited  in 
Tables  A-I  and  A-II,  respectively,  in  the  appendix. 

In  Test  Problem  1,  the  right-hand  sides  of  the  subproblem  constraints 
were  first  fixed  at  three  times  the  sum  of  the  corresponding  row  coeffi- 
cients (RHS  = 300%)-  Attempts  were  made  to  solve  the  problem,  both  by 
the  decomposition  algorithm  and  by  the  standard  branch-and-bound  algorithm, 
for  TR  = 0.33,  1.00,  I.67.  These  test  results  are  recorded,  in  Table  I, 
and  are  plotted  in  Figure  1.  The  right-hand  sides  of  the  subproblem 
constraints  were  next  set  equal  to  RHS  = 500$,  and  the  problem  was 
rerun  with  TR  = 0.2,  oA,  0.6,  0.8.  The  solution  times  for  these  runs 
are  shown  in  Table  II,  and  are  plotted  in  Figure  2. 
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TABLE  I 


\ 


Test  Problem  1:  RHS  = 300$ 

SOLUTION  TIMES  AS  A FUNCTION  OF  LINKING  CONSTRAINT  TIGHTNESS 


TIGHTNESS  RATIO 

Algorithm 

0-33 

1.00 

I.67 

DSLC 

2.45 

6.15 

6.08 

BB 

5-96 

20.54 

> 8.30^ 

DSL C = Decomposition  algorithm  for  single  linking  constraint  case 
BB  = Branch-and-bound  algorithm 


TABLE  II 

Test  Problem  1:  RHS  = 500$ 

SOLUTION  TIMES  AS  A FUNCTION  OF  LINKING  CONSTRAINT  TIGHTNESS 


TIGHTNESS 

RATIO 

Algorithm 

0.2 

0.4 

0.6 

0.8 

DSLC 

1-79 

4.88 

4.44 

> 20 

BB 

0.58 

7.25 

8.67 

> 20 

— The  two  cases TR  = 1.00,  TR  = 1.67  were  attempted  on  the  same  run, 
with  a combined  time  limit  of  30  seconds  for  the  job.  WATFIV  compilation 
required  1.16  seconds. 


J 
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.33  .67  1.00  1.33  1.67  2.00 

TIGHTNESS  RATIO 

Figure  1:  Solution  times  for  Test  Problem  1 (RHS  = 300$) 


.2  .4  .6  .8  1.0 

TIGHTNESS  RATIO 

Figure  2:  Solution  times  for  Test  Problem  1 (RHS  = 5 00$) 


109 


Test  Problem  2 was  treated  in  much  the  same  way  as  Problem  1.  The 
results  obtained  under  various  levels  of  linking  constraint  tightness  for 
the  two  cases,  RHS  = 500$  and  RHS  = 500$,  are  presented  in  Table  III 
and  Figure  3,  and  in  Table  IV  and  Figure  4,  respectively.  All  times  shown 
for  both  test  problems  represent  the  total  time  during  which  the  IBM 
370/l68  central  processing  unit  was  available  to  the  core  partition 
containing  the  job.  Since  these  two  test  problems  were  run  under  object 
code  produced  by  WATFIV  compiler,  the  solution  times  shown  may  be  much 
greater  (typically  by  a factor  of  about  seven)  than  those  which  would 
have  been  obtained  had  the  FORTRAN-H-Extended  compiler  been  used.  This 
presents  no  difficulty  for  our  purposes,  however,  since  it  is  the  relation- 
ships between  these  solution  times,  rather  than  the  magnitude  of  the 
times  themselves,  that  is  of  key  importance. 

6.3  Test  Problem  3 

Our  third  test  problem  was  derived  from  a 20-variable,  10-constraint 
capital  budgeting  problem  reported  by  Fleisher  (1976).  Following  a pro- 
cedure similar  to  that  used  by  Reardon,  the  data  in  Fleisher' s problem 
was  transformed  so  as  to  yield  a problem  with  the  block  angular  structure. 
First,  the  twenty  projects  in  the  original  problem  were  divided  into 
forty  projects,  governed  by  five,  rather  than  ten,  constraint  rows. 

That  is,  the  first  five  rows  of  the  constraint  matrix  were  taken  to 
represent  one  group  of  twenty  projects,  and  the  last  five  rows  represented 
a second  group.  The  original  objective  coefficients  were  retained  for 
each  of  the  revised  projects;  e.g.,  since  both  columns  one  and  two  in 
our  4o-variable  problem  were  obtained  from  column  one  of  the  original 
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TABLE  IV 

Test  Problem  2:  RHS  = 500# 

SOLUTION  TIMES  AS  A FUNCTION  OF  LINKING  CONSTRAINT  TIGHTNESS 

I 



■ i - - — i i — . - i.  » ■■  ■ - 

TIGHTNESS  RATIO 


Algorithm 


0.2 


0.4 


0.6 


0.8 


TIME  (SEC.)  TIME  (SEC.) 


Figure  k:  Solution  times  for  Test  Problem  2 (RHS  = 500$) 
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problem,  each  was  assigned  the  cost  coefficient  from  column  one  of  the 
original  problem. 

The  forty  revised  projects  were  next  grouped  into  eight  subproblems 
of  five  variables  and  five  constraint  rows  each.  The  coefficients  in 
the  last  row  of  each  subproblem  were  then  removed  and  used  to  form  the 
linking  constraint  instead.  The  resulting  block  angular  integer  program 
thus  had  four  rows  and  five  columns  in  each  of  eight  subproblems,  and 
one  linking  constraint.  The  coefficients  defining  this  problem  are 
given  in  Table  A- III  in  the  appendix. 

The  performance  of  the  decomposition  algorithm  in  relation  to  linking 
constraint  tightness  was  tested  on  the  derivative  problem  consisting  of 
the  first  four  subproblems  of  Test  Problem  5.  The  right-hand  sides  in 
the  subproblem  constraints  were  set  to  three  times  the  sum  of  the  corres- 
ponding row  coefficients,  and  four  different  values  for  the  tightness 
ratio  TR  were  tried  in  turn.  The  results  obtained  from  both  the 
decomposition  and  the  branch-and-bound  codes  are  presented  in  Table  V 
and  Figure  5 • 

TABLE  V 

Test  Problem  3:  RHS  = 300$ 

SOLUTION  TIMES  AS  A FUNCTION  OF  LINKING  CONSTRAINT  TIGHTNESS 


TIGHTNESS  RATIO 

Algorithm 

0.35 

O.67 

1.00 

1.55 

DSLC 

1.74 

5.05 

8.24 

6.85 

BB 

0.85 

4.54 

15.28 

25.54 

; 
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From  these  results,  it  appeared  that  while  the  standard  branch-and- 
bound  algorithm  enjoyed  a slight  advantage  over  the  decomposition  approach 
for  small  values  of  TR,  the  advantage  turned  in  favor  of  the  latter  as 
TR  increased.  Since  the  turning  point  was  observed  to  be  approximately 
TR  = O.67,  it  was  decided  to  fix  TR  at  this  level  in  examining  the 
effects  on  solution  times  of  increasing  problem  size.  Thus,  with  RHS  = 
300$  again  in  each  subproblem,  and  TR  = O.67  always,  the  two  additional 
derivative  problems  consisting,  respectively,  of  the  first  two  and  the 
first  six  subproblems  of  Test  Problem  3 were  solved.  (The  four-subproblem 
derivative,  of  course,  had  been  solved  previously.)  The  results  are 
shown  in  Table  VI,  and  are  plotted  in  Figure  6.  In  view  of  the  unexpec- 
tedly large  increase  in  solution  times  observed  in  increasing  the  overall 
problem  size  from  four  to  six  subprobleras,  it  was  decided  not  to  solve 
the  eight- subproblem  case. 

In  each  of  the  six  versions  of  Test  Problem  3 that  were  solved, 
the  quality  of  the  successive  incumbent  solutions  obtained  by  each  of 


TABLE  VI 


Test  Problem  3:  TR  = O.67 


SOLUTION  TIMES  AS  A FUNCTION  OF  PROBLEM  SIZE 


Algorithm 


NUMBER  OF  SUBPROBLEMS 


1.34  5-03  26.60 

0.78  4.34  53-31 


the  two  codes  was  monitored  as  described  in  Section  6.1.  The  results 
are  shown  in  Tables  VII-XII,  respectively.  Two  measures  of  the  "quality" 


of  a nonoptimal  solution  were  computed,  as  indicated  in  the  tables.  In 

.(D* 


general,  the  percent  error  of  a given  incumbent  solution  (x'  ,, 

for  any  N-subproblem  derivative  of  Test  Problem  3 is  defined  by 


,.«i 


1 .«>;»>  - Z 


e = 


j=l 


0=1 


N 


x 100$ 


(1) 


0=1 


\ A / _ - \ 

where  (x^  , . . . , x^  ) represents  the  optimal  solution  to  the  given 


problem.  Similarly,  following  Hillier  (1969),  the  normalized  deviation 


. V * . V * 

from  optimality  for  (x^  , ...  , x^  ) is  defined  by 


d = 


N / • \/'/  • \ N 

0=1 isi 


£ <W3;  - E C^x^’ 


(2) 


W 

E 

0=1 


2 


It  is  easy  to  show  that  d represents  the  Euclidean  distance  in  R 


N 


(n  = E n-)  from  the  point  (x^  , ...  , x''1N;  ) to  the  hyperplane 


(n) 


0=1 


0 


N 


given  by 


N 


= E c^x^E  Of  the  two,  therefore,  the  normal- 


0=1  0=1 

ized  deviation  from  optimality  represents  a less  problem-dependent  measure 


of  the  quality  of  a nonoptimal  solution.  The  normalized  deviations  from 
optimality  of  the  successive  incumbent  solutions  obtained  by  the  two  codes 
are  plotted  as  a function  of  computation  time  for  the  six  derivative 
problems  in  Figures  7-12 • 
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TABLE  VII 


Test  Problem  3:  Four-Subproblem  Derivative,  TR  = 0.33 


QUALITY  OF  INCUMBENT  SOLUTIONS 


Objective 

Value 


Norm.  Dev 


from  Opt 


Time 


10397 


0000 


Objective 

Value 


Norm.  Dev 


Time 


from  Opt 


Error 


10505 


10539 


0000 


TABLE  VIII 

Test  Problem  3:  Four-Subproblem  Derivative,  TR  = 1.00 

QUALITY  OF  INCUMBENT  SOLUTIONS 


Time 

Objective 

Value 

$ Error 

Norm.  Dev. 
from  Opt. 

Time 

Objective 

Value 

Error 

Norm.  Dev. 
from  Opt. 

0.46 

14 148 

0.84 

.1222 

0. 75 

12753 

10.76 

1.5643 

2.02 

14150 

0.83 

.1202 

0.75 

13757 

3.58 

• 5207 

5.17 

l4l6l 

0.75 

.109  o 

0.76 

13791 

3-34 

.4861 

5-32 

14187 

0.57 

.0825 

0.77 

13859 

2.87 

.4168 

5-51 

14215 

0.37 

.0540 

0.78 

13905 

2.54 

.3699 

6.18 

14229 

0.27 

•0397 

0.78 

13973 

2.07 

.3006 

6.47 

14260 

0.06 

.0081 

0.97 

14002 

1.87 

.2710 

7-62 

14268 

0.00 

.0000 

1.02 

14019 

1-75 

• 2537 

1.11 

14058 

1.47 

.2140 

1.88 

14078 

1-33 

.1936 

3.21 

14079 

1.32 

.1926 

3.22 

14147 

0.85 

• 1233 

4.83 

14190 

0.55 

.0794 

5.25 

14191 

0.54 

.0784 

5-41 

14199 

0.48 

.0703 

7-03 

14228 

0.28 

.0407 

7-20 

14233 

0.25 

• 0356 

7.64 

14234 

0.24 

.0346 

7-90 

14253 

0.11 

.0152 

11.36 

14259 

0.06 

.0091 

11.78 

14260 

0.06 

.0081 

12.19 

14268 

0.00 

.0000 
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Figure  Quality  of  incumbent  solutions.  Test  Problem  3 
(four-subproblem  derivative,  TR  = 0.33) 
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Figure  8:  Quality  of  incumbent  solutions.  Test  Problem  3 

(four-subproblem  derivative,  TR  = 1.00) 


Value 


15025 

15033 


0.05 

0.00 


.0081 

.0000 


0.73 
0.75 
O.78 
O.87 
0.9^ 
1.03 
1.25 
I.27 
1.37 


TABLE  IX 


Test  Problem  3:  Four-Subproblem  Derviative,  TR  = 1.33 


QUALITY  OF  INCUMBENT  SOLUTIONS 


Objective 


Norm,  Dev. 
Error  from  Opt . 


Objective 
Time  Value 


Norm.  Dev. 
Error  from  Opt. 


I 


TABLE  X 

Test  Problem  3:  Two-Subproblem  Derivative,  TR  = 0.67 

QUALITY  OF  INCUMBENT  SOLUTIONS 


Time 

Objective 

Value 

DSLC 

Error 

Norm.  Dev. 
from  Opt. 

Time 

Objective 

Value 

BB 

^ Error 

Norm.  Dev. 
from  Opt. 

0.77 

6436 

0-97 

.0899 

0.19 

6l4l 

5.51 

.5112 

0.79 

6b  99 

0.00 

0000 

0.20 

6209 

4.46 

.4141 

0.21 

6255 

3-75 

.3484 

0.23 

6340 

2.45 

.2270 

0.31 

6352 

2.26 

.2099 

0.36 

6369 

2.00 

.1856 

0.47 

6377 

1.88 

.1742 

0.48 

6445 

0.83 

• 0771 

0.68 

6482 

0.26 

.0242 

0.71 

6499 

0.00 

.0000 

TABLE  XI 

Test  Problem  3:  Four -Sub problem  Derivative,  TR  = 0.67 

QUALITY  OF  INCUMBENT  SOLUTIONS 


1 


1 


DSLC 


Time 

Objective 

Value 

<t  Error 

Norm.  Dev 
from  Opt. 

0.36 

13083 

0.62 

.0835 

1.65 

13137 

0.21 

.0285 

1.72 

13143 

0.17 

.0224 

1.83 

13157 

0.06 

. 008: 

3.70 

13165 

0.00 

.0000 

Time 

Objective 

Value 

BB 

% Error 

Norm  Dev 
from  Opt. 

0-55 

13034 

1.00 

.1335 

0.61 

13057 

0.82 

.1100 

0.73 

13077 

0.67 

.0896 

0.76 

13151 

0.11 

.0142 

1.22 

13165 

0.00 

.0000 
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Figure  10:  Quality  of  incumbent  solutions.  Test  Problem  5 

(two-subproblem  derivative,  TR  = 0.67) 


TABLE  XII 

Test  Problem  3:  Six-Subproblem  Derivative,  TR  = 0.67 

QUALITY  OF  INCUMBENT  SOLUTIONS 


Time 

Objective 

Value 

$ Error 

Norm.  Dev. 
from  Opt. 

Time 

Objective 

Value 

% Error 

Norm.  Dev. 
from  Opt. 

0.64 

17923 

1.46 

.2302 

1.29 

16604 

8.71 

1-3764 

1.21 

17986 

1.11 

• 1755 

1.30 

I6938 

6.87 

1.0862 

2.51 

18037 

0.83 

.1312 

1.32 

17246 

5.18 

.8185 

2.89 

18151 

0.20 

.0321 

1.33 

17791 

2.18 

.3449 

4.17 

18188 

0.00 

.0000 

1-35 

17834 

1.95 

.3076 

1.35 

17877 

1-71 

.2702 

1.36 

18099 

0.49 

• 0773 

1.37 

18119 

0.38 

.0599 

2. 04 

18173 

0.08 

.0130 

4.36 

18188 

0.00 

.0000 
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Figure  11:  Quality  of  incumbent  sol 
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Figure  12:  Quality  of  incumbent  solutions,  Test  Problem  3 

(six-subproblem  derivative,  TR  = O.67) 
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6.4  Test  Problem  4 


The  data  for  the  fourth  test  problem  was  taken  from  the  seventh 
of  the  R & D project  selection  problems  reported  by  Petersen  (1967)* 

To  obtain  a problem  with  the  block  angular  structure,  Petersen’s  50- 
variable,  5-constraint  problem  was  divided  into  ten  subproblems  of  five 
columns  and  five  rows  each.  The  coefficients  in  the  first  constraint 
in  each  subproblem  were  then  removed  and  used  to  form  the  linking  con- 
straint instead.  Finally,  each  of  the  objective  coefficients  was  divided 
by  ten,  and  rounded  to  the  nearest  integer.  Test  Problem  4 is  exhibited 
in  Table  A -IV  in  the  appendix. 


I 


Because -tiie  decision  variables  in  many  practical  integer  programming 
problems  are  restricted  to  take  on  only  the  values  zero  or  one,  it  was 
felt  that  the  testing  of  the  decomposition  algorithm  should  include  at 
least  one  such  problem.  Consequently,  in  each  of  the  (five)  derivative 
problems  of  Test  Problem  4,  unit  upper  bounds  were  specified  on  all 
variables.  The  subproblem  constraint  right-hand  sides  were  fixed  at 
(approximately)  RHS  = 70$.  (This  was  the  setting  used  in  the  zero-one 
test  problems  giver,  by  Reardon  (197*0-)  Correspondingly,  the  linking 
constraint  right-hand  side  was  chosen  always  to  be  approximately  4o$ 


r 


• - ^ • 


* 


located  the  optimal  solution  for  the  last  derivative  problem  in  less  than 
31  seconds,  it  had  still  failed  to  verify  the  optimality  of  this  solution 
after  60  seconds  (total)  of  CFU  usage,  and  computations  were  terminated 
prematurely. 

As  with  Test  Problem  3,  the  quality  of  the  incumbent  solutions 
produced  by  each  of  the  two  codes  was  observed  in  each  of  the  five  deri- 
vative problems.  With  "percent  error"  and  "normalized  deviation  from 
optimality"  again  defined  by  (l),  (2),  these  intermediate  results  are 
shown  in  Tables  XIV-XVIII.  The  normalized  deviation  from  optimality  of 
the  successive  incumbent  solutions  is  plotted  as  a function  of  computation 
time  in  Figures  lU-l8. 

6.5  Summary  of  Computational  Results 

The  results  obtained  in  the  first  three  test  problems  (specifically, 
those  plotted  in  Figures  l-1)-)  support  the  conjecture  made  in  Section  6.1; 
for  these  problems,  the  decomposition  algorithm  has  enjoyed  its  greatest 
computational  advantage  over  the  nondecomposition  approach  for  the  larger 
test  values  of  the  tightness  ratio  TR.  In  particular,  in  our  limited 
experimental  sample,  the  ratio  TR  = O.67  emerged  as  the  level  of  linking 
constraint  tightness  above  which  the  decomposition  procedure  was  con- 
sistently and  significantly  more  effective  than  the  standard  branch-and- 
bound  algorithm.  However,  the  solution  times  required  by  the  decomposition 
method  were  always  competitive  with,  and  often  superior  to,  those  required 
by  the  branch-and-bound  algorithm  for  tightness  ratios  even  as  low  as 
TR  = 0.2. 

The  results  of  experiments  with  increasing  problem  size  in  Test 
Problems  3 and  4 were  less  conclusive.  Figures  6 and  13  indicate  that 
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TABLE  XIII 


Test  Problem  4:  TR  = 0.5T 


SOLUTION  TIMES  AS  A FUNCTION  OF  PROBLEM  SIZE 


QUALITY  OF  INCUMBENT  SOLUTIONS 


DSLC 


Objective 

Norm . Dev . 

Time 

Value 

$ Error 

from  Opt. 

0.15 

230 

9-80 

•0959 

0.22 

255 

0.00 

.0000 

BB 


Time 

Objective 

Value 

<%  Error 

Norm.  Dev. 
from  Opt. 

0.12 

243 

4.71 

. 0460 

0.13 

253 

0.78 

.0076 

0.14 

255 

0.00 

.0000 
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Figure  14 : Quality  of  incumbent  solutions.  Test  Problem  4 

(two-subproblem  derivative,  TR  = 0.57) 
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TABLE  XV 

Test  Problem  4:  Four-Subproblem  Derivative,  TR  = 0.57 

QUALITY  OF  INCUMBENT  SOLUTIONS 


Time 

Objective 

Value 

DSLC 
$ Error 

Norm.  Dev. 
from  Opt. 

Time 

Objective 

Value 

BB 

Error 

Norm.  Dev. 
from  Opt. 

0.29 

442 

4.55 

.0596 

0.44 

414 

10.59 

.0951 

0.57 

450 

2.6o 

.0257 

0.46 

451 

6.71 

• 06l4 

0.47 

452 

2.16 

.0198 

0.51 

445 

CO 

MD 

.0556 

0.47 

455 

1.52 

.0158 

0.51 

462 

0.00 

.0000 

0.57 

457 

1. 08 

.0099 

0.6o 

462 

0.00 

.0000 

Time 

Test 

Objective 

Value 

TABLE  XVI 

Problem  4:  Six-Subproblem  Derivative,  TR  = 0.57 

QUALITY  OF  INCUMBENT  SOLUTIONS 

DSLC  BB 

Norm.  Dev.  Objective 

$ Error  from  Opt.  Time  Value  % Error 

Norm.  Dev. 
from  Opt. 

0.40 

557 

5.94 

.0450  O.96  559  0.00 

.0000 

0.75 

541 

5.22 

.0552 

0.74 

544 

2.68 

.0295 

1.19 

545 

2.50 

.0275 

1.21 

546 

2.52 

.0254 

1.27 

552 

1.25 

.0156 

1.57 

555 

1.07 

.0117 

1.58 

554 

O.89 

.0097 

1.48 

556 

0.54 

.0058 

1.51 

559 

0.00 

.0000 

3 
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Figure  1 6:  Quality  of  incumbent  solutions,  Test  Problem  4 

(six-subproblem  derivative,  TR  = 0.57) 
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TABLE  XVII 

Test  Problem  4:  Eight -Sub problem  Derivative,  TR  = 0.57 

QUALITY  OF  INCUMBENT  SOLUTIONS 


DSLC  BB 


Time 

Objective 

Value 

$ Error 

Norm.  Dev. 
from  Opt. 

Time 

Objective 

Value 

% Error 

Norm.  Dev. 
from  Opt. 

0.52 

667 

2.78 

• 0365 

1.85 

675 

1.60 

.0211 

0.80 

670 

2.33 

.0307 

1.95 

677 

1.31 

• 0173 

1. 08 

672 

2.04 

.0269 

1.96 

680 

0.87 

.0115 

1.31 

674 

1-75 

.0230 

2.72 

681 

0.73 

.0096 

1.64 

675 

1.60 

.0211 

2.85 

684 

0.29 

.0038 

1.72 

676 

1.46 

.0192 

5-56 

686 

0.00 

.0000 

1.76 

677 

1.31 

•0173 

1.79 

679 

1.02 

.0134 

1.90 

680 

0.87 

.0115 

1.94 

682 

0.58 

.0076 

3.07 

683 

0.44 

• 0057 

3.19 

686 

0.00 

• 0000 
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TABLE  XVIII 


Test  Problem  4:  Ten-Subproblem  Derivative,  TR  = 0.57 

QUALITY  OF  INCUMBENT  SOLUTIONS 


i 


I 


DSLC  BB 


Time 

Objective 

Value 

$ Error 

Norm.  Dev 
from  Opt. 

Time 

Objective 

Value 

°to  Error 

Norm  Dev. 
from  Opt. 

0.65 

984 

5.93 

• 0973 

2.84 

900 

13.96 

.2292 

0.72 

1031 

1.43 

.0235 

2.88 

917 

12.33 

.2025 

0.85 

1034 

1.15 

.0188 

2.97 

922 

11.85 

.1947 

O.96 

1038 

0.76 

.0125 

3.20 

936 

10.52 

.1727 

1.71 

1040 

0.57 

.0094 

3-32 

953 

8.89 

.1460 

3-93 

10^  1 

0.48 

.0078 

3.69 

973 

6.98 

.1146 

10.37 

1042 

0.38 

.0062 

3.71 

975 

6.79 

.1114 

10.39 

1043 

0.29 

.0047 

3.76 

980 

6.31 

.1036 

10.41 

1045 

0.10 

.0015 

4.59 

981 

6.21 

.1020 

30.80 

1046 

0.00 

.0000 

6.4o 

982 

6.12 

.1005 

8.63 

984 

5-93 

•0973 

22.12 

1008 

3.63 

.0596 

22.13 

1041 

0.48 

.0078 

22.16 

1043 

0.29 

.0047 

22.59 

1045 

0.10 

.0015 

22.82 

1046 

0.00 

.0000 

H.OJ 

S 


a 

o .02 


Q 

w 

a.  01 


.20 


12  3 

COMPUTATION  TIME  (SE 

Figure  17:  Quality  of  incumbent  sol 

(eight- subproblem  deriva 
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Figure  18:  Quality  of  incumbent  solutions,  Test  Problem  4 

(ten-subproblem  derivative,  TR  = 0.57) 


for  small  problems  (few  subproblems),  solution  times  with  the  decomposition 
method  are  comparable  to  those  obtained  with  the  branch-and-bound  procedure. 
As  overall  problem  size  was  increased  (by  adding  more  subproblems,  each 
of  the  same  size),  both  methods  exhibited  what  appears  to  be  an  exponential 
growth  in  the  corresponding  solution  times.  Nonetheless,  the  results 
obtained  with  the  decomposition  procedure  usually  represented  a marked 
computational  savings  in  the  larger  test  problems. 

The  notable  exception  to  this  rule,  however,  was  the  ten-subproblem 
derivative  of  Test  Problem  4,  where  the  decomposition  algorithm  had  still 
failed  to  terminate  in  over  twice  the  total  solution  time  required  by 
the  branch-and-bound  code.  One  possible  cause  for  this  result  might  be 
that  the  decision  variables  in  this  problem  were  restricted  to  take  on 
only  the  values  zero  or  one.  Since  increasing  the  number  of  subproblems 
also  increases  the  number  of  allocation  variables  requires  for  decompo- 
sition, it  may  be  that  the  number  of  combinations  of  allocation  variables 
which  must  be  examined  in  the  decomposition  approach  increases  at  a faster 
pace  than  does  the  number  of  combinations  of  the  original  0-1  decision 
variables  which  must  be  examined  in  the  branch-and-bound  procedure.  If 
this  is  indeed  the  case,  the  decomposition  algorithm  may  experience 
difficulties  with  large  block  angular  zero-one  integer  programs. 

However,  since  the  gap  in  solution  times  in  Test  Problem  4 widened 
in  favor  of  the  decomposition  method  as  the  number  of  subproblems  was 
gradually  increased  from  two  to  eight,  the  result  in  the  ten-subproblem 
derivative  is  not  necessarily  representative  of  the  general  behavior 
of  the  two  algorithms.  Moreover,  the  fact  that  a tightness  ratio  of 
TE  = 0.57  was  maintained  in  the  fourth  test  problem  must  also  be 
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considered.  This  level  of  linking  constraint  tightness  is  below  the 


critical"  value  of  TR 


test  problems}  while  the  decomposition  method  was  consistently  superior 


to  the  branch-and-bound  algorithm  when  TR  > 0.67*  neither  method  enjoyed 


a clear-cut  advantage  in  test  problems  with  TR  < 0.67-  In  this  light 


the  results  in  Test  Problem  4 may  equally  well  be  considered  as  an  indi 


cation  that  the  degree  of  linking  constraint  tightness  is  a more  crucial 


factor  in  determining  the  consistency  of  the  effectiveness  of  decomposition 


than  is  problem  size.  Verification  of  this  hypothesis  in  further  compu 


tational  tests  has  important  implications  for  the  user  who  must  select 


a single  method  for  a given  application,  since  the  tightness  ratio  TR 


is  a simple  measure  which  can  be  readily  approximated  from  problem  data 


Finally,  the  intermediate  results  obtained  in  Test  Problems  3 and  4 


see  Figures  7-12  and  14-18)  would  strongly  encourage  the  use  of  the 


decomposition  algorithm  as  a heuristic  procedure  for  block  angular  integer 


programs  which  may  be  too  large  to  solve  optimally,  or  for  which  an  exact 


optimal  solution  is  not  required.  As  a measure  of  the  effectiveness  of 


decomposition  in  quickly  identifying  good  (suboptimal)  solutions,  let 


t,  denote  the  computation  time  required  by  the  decomposition  algorithm 


to  find  a first  feasible  solution  to  a given  problem,  and  correspondingly, 


let  t0  denote  the  time  required  by  the  branch-and-bound  algorithm  to 


reach  a feasible  solution  of  the  same  quality.  In  the  various  versions 


of  Test  Problems  3 and  4 that  were  solved,  t?  was  observed  to  range 
from  2 to  43  times  t ^ In  particular,  in  the  two  largest  derivatives 


— The  single  exception  was  the  two- subproblem  derivative  of  Test  Problem  4. 
Because  of  its  small  size,  however,  this  problem  is  so  easily  solved  opti- 
mally that  the  use  of  a heuristic  procedure  would  be  questionable  in  any  event 


of  these  problems  - the  first  with  30  general  integer  variables  and  the 
second  with  50  zero-one  variables  overall  - the  decomposition  procedure 
reached  a first  feasible  solution  in  0.64  and  0.65  seconds,  respectively. 
By  comparison,  the  branch-and-bound  algorithm  required  1.35  and  8.63 
seconds,  respectively,  to  locate  integer  feasible  solutions  of  approxi- 
mately the  same  quality.  These  results  are  especially  encouraging  in 
view  of  the  fact  that  the  corresponding  tightness  ratios  of  TR  = O.67 
and  TR  = 0.57  were  fairly  small. 

In  general,  the  decomposition  procedure  consistently  and  quickly 
produced  initial  feasible  solutions  of  high  quality.  Moreover,  its 
advantage  over  the  branch-and-bound  algorithm  in  this  regard  increased 
with  increasing  problem  difficulty.  In  Test  Problem  4 in  particular, 
t^  was  observed  to  increase  approximately  linearly  with  increasing 
problem  size.  Recall  that  when  the  block  angular  integer  program  (P) 
is  decomposed  into  its  component  subproblems,  the  work  required  to 
generate  a first  incumbent  essentially  involves  the  solution  of  N 
parametric  linear  programs,  followed  by  the  solution  of  N integer 
programming  problems.  If  the  total  problem  size  is  doubled,  therefore, 
the  work  to  find  a first  feasible  solution  involves  not  the  solution 
of  linear  and  integer  programming  problems  of  twice  the  original  size, 
but  rather  the  solution  of  twice  as  many  linear  and  integer  programs 
of  the  same  size.  Hence,  there  is  reason  to  expect  that,  at  least  in 
the  single  linking  constraint  case,  the  observed  linear  increase  in 
the  computation  time  required  by  the  decomposition  algorithm  to  obtain 
a first  feasible  solution  will  extend  to  other,  larger  block  angular 
integer  programs  as  well. 
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CHAPTER  7 

CONCLUSIONS,  EXTENSIONS , AND  AREAS  FOR  FUTURE  RESEARCH 


7-1  Conclusions 

The  computational  results  reported  in  Chapter  6 are  too  few  to  draw 
any  final  conclusions  concerning  the  performance  of  the  decomposition 
algorithm.  Nonetheless,  these  first  experiments  would  indicate  that 
our  procedure  for  the  decomposition  of  block  angular  integer  programs 
can  be  an  attractive  alternative  to  standard  integer  programming  methods 
which  ignore  problem  structure.  In  particular  the  decomposition  approach 
has  been  most  effective  in  treating  problems  in  which  the  linking  con- 
straints are  fairly  loose  relative  to  the  subproblem  constraints;  in 
terms  of  the  measure  of  relative  linking  constraint  tightness  TR 
defined  in  Section  6.1,  solution  times  exhibited  by  the  decomposition 
algorithm  in  problems  with  TR  > O.67  were  ^5-70$  less  than  those 
required  by  a nondecomposition  approach  to  the  same  problems.  Thus, 
it  may  well  be  possible  to  determine  in  advance  (by  approximating  TR 
from  the  problem  data)  which  problems  can  be  most  efficiently  solved 


through  the  decomposition  approach. 

Also  encouraging  was  the  observation  that  computation  times 
required  by  the  decomposition  algorithm  usually  experienced  a significantly 
less  rapid  growth  with  increasing  problem  size  than  did  the  corresponding 
times  for  the  standard  branch-and-bound  procedure.  There  was  one  major 
exception  to  this  trend,  however,  and  more  extensive  computational  testing 


of  the  algorithm  on  other  and  larger  block  angular  problems  would  be 


Mbfci 


of  alternative  branching  strategies  as  well.  One  such  alternative  was 


There  is  also  the  need  for  continued  computational  analysis  of  the 


performance  of  the  decomposition  algorithm.  In  addition  to  the  problem 


parameters  investigated  in  Chapter  6,  two  others  which  may  have  important 


effects  on  algorithmic  efficiency  are  the  number  of  linking  constraints 


and  (average)  subproblem  size.  It  would  be  extremely  useful  from  a 


practical  viewpoint  to  identify  the  ranges  of  these  parameters  for  which 


the  decomposition  procedure  is  most  effective 


The  algorithm  for  decomposing  block  angular  integer  programs  often 


can  require  that  several  different  versions  of  each  of  the  subproblems 


be  solved.  Since  these  versions  will  differ  from  one  another  only  in  the 


right-hand  sides  of  the  linking  constraints,  it  may  well  turn  out  that 


significant  computational  savings  can  be  achieved  by  incorporating 


techniques  for  solving  these  subproblems  parametrically,  or  for  conduc 


ting  sensitivity  analyses  on  the  optimal  subproblem  solutions.  Recently, 


many  advances  have  been  made  in  the  areas  of  parametric  integer  pro> 


gramming  and  postoptimality  analysis  in  integer  programming 


techniques  may  be  particularly  valuable  for  block  angular  integer  pro 


grams  in  which  the  subproblems  themselves  are  fairly  large,  since  greater 


proportions  of  the  total  solution  time  for  these  problems  will  be  spent 


in  generating  the  subproblem  solutions 


A closely  related  issue  is  the  question  of  optimal  degree  of  decoim 


position.  In  the  algorithm  developed  here,  each  of  the  subproblems  is 


— See,  for  example,  Geoffrion  and  Nauss  (1976),  Piper  and  Zoltners 
(1975),  (1976),  Radke  (1975),  Roodman  (1972),  and  Nauss  (1975). 


treated  individually.  In  a sense,  the  straightforward  branch -and-bound 
procedure  is  simply  an  alternative  version  of  the  decomposition  algorithm 
in  which  all  the  subproblems  are  combined  and  treated  as  one.  Inter- 
mediate versions  between  these  two  extremes  are  certainly  possible  as 
well.  Since  the  straightforward  branch-and-bound  algorithm  proved  slightly 
superior  to  the  decomposition  approach  in  the  two-subproblem  derivatives 
of  Test  Problems  3 and  4,  it  seems  reasonable  to  consider,  for  example, 
pairing  individual  subproblems  and  treating  each  such  combined  pair 
as  a single  subproblem  when  the  decomposition  algorithm  is  applied.  In 
general,  it  would  be  interesting  to  compare  solution  times  resulting  from 
various  different  strategies  for  grouping  the  subproblems.  Since  partial 
decomposition  approaches  necessarily  will  lead  to  increased  subproblem 
sizes,  the  incorporation  of  efficient  parametric  integer  programming 
capabilities  may  well  be  an  important  factor  in  determing  the  relative 
effectiveness  of  different  degrees  of  decomposition. 

Underlying  the  branching  procedure  in  the  decomposition  algorithm 
is  the  assumption  that  the  allocation  variables  can  take  on  only  discrete 
values.  In  the  present  work,  we  have  guaranteed  that  this  will  always 
be  the  case  by  assuming  that  1)  all  linking  constraint  coefficients  in 
the  block  angular  integer  program  (p)  are  integral,— ^ and  2)  all  decision 


— Rational  coefficients  can  always  be  made  integral.  Moreover,  since 
digital  computers  can  represent  problem  coefficients  only  with  finitely 
many  decimal  places,  in  principle  it  is  always  possible  to  render  all 
coefficients  integral  by  scaling  appropriately.  However,  because  the 
magnitude  of  the  resulting  (integral)  coefficients  may  be  quite  large, 
this  approach  to  circumventing  assumption  1)  can  lead  to  serious  diffi- 
culties with  the  numerical  stability  of  the  algorithm. 
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variables  are  integer-restricted.  As  was  previously  mentioned,  in  certain 
applications  physical  considerations  may  naturally  imply  that  the  allo- 
cation variables  can  be  meaningfully  interpreted  only  at  discrete  levels 
(e.g.,  if  they  actually  represent  resources  which  can  be  subdivided  only 
in  integral  amounts).  In  such  cases,  our  method  is  applicable  even  when 
assumptions  1)  and  2)  are  not  satisfied.  Nonetheless,  a valuable  extension 
in  the  range  of  problems  for  which  the  decomposition  algorithm  is  suitable 
would  be  obtained  if  one  or  both  of  these  conditions  could  be  dropped. 

The  second  assumption  in  particular  rules  out  the  important  class  of 
mixed-integer  programming  problems.  Benders  (1962)  has  developed  a 
procedure  for  decomposing  general  mixed-integer  programming  problems  into 
their  integer  and  linear  programming  component  parts,  and  a similar  approach 
might  be  considered  here.  The  resulting  integer  programming  component, 
however,  must  retain  its  block  angular  structure  without  violating  the 
first  assumption  above. 

The  multi-stage  integer  program  (Q,)  exhibited  below  is  quite  similar 
in  structure  to  the  block  angular  problem. 


(Q.) 

maximize  c(l)x(l)re(2)x(2)tc(5)x(5)+...+c(ll-l)x(B-1)+c(B)x(K)  ; 
subject  to 

A<2)x(2W2)x^  < p<2> 


,(J> 


i(N-l)x(N-l)+B(N-l)x(N)  5 P(N-1) 
, N . 


> 0,  integer,  j = 1,  2,  ... 


By  properly  reordering  the  constraint  rows,  (q)  can  be  put  into  block 
angular  form.  This  can  be  done,  for  example,  by  moving  alternate  levels 
^(j)x(j)  + ^ (j  = 3,  5,  etc.)  to  the  top  to  form 

the  linking  constraints.  The  remaining  levels  + B^x^+"^ 

< (j  =2,  4,  6,  etc.)  then  form  the  subproblems ' constraints. 

The  decomposition  algorithm  for  block  angular  integer  programs  can  thus 
be  applied  to  problem  (Q).  Some  effort  should  be  made,  however,  to 
exploit  the  special  structure  of  the  linking  constraints  themselves  in 
such  problems.  For  example,  each  subproblem  will  have  all-zero  coeffi- 


cients in  many  of  the  linking  constraints.  The  total  number  of  allo- 
cation variables  required  for  decomposition  can  be  reduced  by  noting  that 
the  allocation  of  the  i^*1  linking  resource  to  the  subproblem  can 

obviously  be  fixed  at  zero  if  the  coefficients  corresponding  to  this 

"fell 

subproblem  are  identically  zero  in  the  i linking  constraint. 

Alternatively,  problem  (Q)  can  be  put  into  dual  angular  form  by 
reordering  the  decision  variables  so  that,  for  example,  the  columns 
corresponding  to  x^  (j  = 1,  3,  5,  etc.)  appear  in  the  left-most 
positions  in  the  revised  constraint  maxuix.  These  variables  then  form 
the  linking  columns,  while  the  subproblems  are  comprised  of  the  remaining 
variables.  Reardon  (1974)  has  developed  an  efficient  decomposition  method 
for  dual  angular  integer  programming  problems.  The  linking  columns  in 
the  dual  angular  problem  obtained  from  the  multi-stage  problem  (q)  will 
again  have  a special  structure  of  their  own,  and  some  effort  should  be 


made  to  exploit  this  fact.  It  would  be  interesting  to  compare  the  per- 
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TABLE  A-I 
Test  Problem  1 


1 

COLUMNS 
2 5 

4 

5 RHS-7 

I.W 

20 

20  15 

15 

20 

8o  55  70  4o  8o  975 

100  10  100  4 90  912 

20  20  20  14  50  512 

40  50  50  29  40  507 

50  55  4o  24  4o  582 


COLUMNS 

1 2 5 4 5 RHS^7 


20  10  10  6 6 


8 8 5 5 5 


bo  45  21  15 

10  75  0 25 


20  8 6 

20  16  12 

20  19  16 


9 390 

6 548 

12  147 


5 12  195 

7 15  251 


COLUMNS 

1 

2 

5 

4 

5 

RH.li7 

=(3) 

8 

8 

29 

29 

20 

a<5) 

8 

8 

5 

5 

5 

28 

18 

90 

29 

130 

885 

b(3) 

28 

0 

120 

6 

130 

852 

12 

10 

14 

18 

4o 

282 

18 

10 

24 

50 

60 

426 

18 

10 

29 

30 

70 

471 

Tightness  Ratio 

0,33  1.00  1.67 

Linking  Constraint 
Right-hand  Side 

116  348  580 

COLUMNS 

12545  RHS^7 


20  7 7 5 5 


8 8 5 5 5 


70  52  21  20  17  4 80 

52  52  5 4o  0 521 


52  52 

42  6 


12  216 


42  16  18  11  18  515 

42  21  20  17  18  554 


S = 500 

Tightness  Ratio 
0.2  0.4  0.6  0.8 


Linking  Constraint  ll6  232  ^3 

Right-hand  Side 


- These  right-nand  sides  represent  the  RHS  = 500#  case, 
is  obtained  by  multiplying  these  values  by  5/5 • 


The  RHS  = 500#  case 


Linking  Constraint 


COLUMNS 

RHS^ 

1 

2 

3 

4 

5 

c'1’ 

65 

65 

33 

33 

16 

8 

8 

3 

5 

5 

120 

35 

4o 

25 

30 

750 

160 

70 

4o 

10 

6o 

1020 

20 

100 

5 

20 

0 

435 

30 

110 

25 

20 

10 

585 

30 

120 

25 

20 

15 

630 

COLUMNS 

1 2 3 4 


5 RHS» 


1 

COLUMNS 
2 3 4 

5 RHS— ^ 

c<5) 

3 

3 130  130 

155 

2 

180 

110 

220 

1545 

0 

24  0 

0 

290 

1608 

1 

20 

20 

30 

213 

2 

80 

40 

60 

549 

3 

100 

50 

70 

672 

Tightness 

Ratio 

0.33 

0.67 

116 

232 

1 

COLUMNS 
2 3 

4 

5 RHS- 

co> 

155 

55  55 

48 

48 

Tightness  Ratio 
0.2  0.4  0.6  0.8 

Linking  Constraint 
Right-hand  Side 

116  232  348  464 

Right-hand  Side 


— These  right-hand  sides  represent  the  RHS  = 300$  case.  The  RHS  = 500$  case 
is  obtained  by  multiplying  these  values  by  5/3* 


TABLE  A -III 
Test  Problem  3 


COLUMNS 

1 

2 3 4 

5 RHS 

B8I 

245 

245 

177 

177 

dy'i. 

EH 

11 

41 

62 

68 

43 

77 

28 

12 

85 

57 

777 

b^ 

21 

32 

85 

42 

87 

801 

72 

77 

58 

18 

72 

891 

7 6 

53 

14 

83 

86 

936 

COLUMNS 

1 

2 

3 

4 

5 

RHS 

m 

237 

237 

194 

194 

211 

Oil 

93 

35 

38 

20 

44 

85 

93 

52 

882 

„(3) 

61 

98 

36 

94 

_L 

870 

93 

37 

17 

4l 

54 

726 

48 

20 

54 

19 

58 

597 

COLUMNS 

1 

2 

3 

4 

5 

RHS 

EH 

291 

237 

237 

114 

114 

Ell 

47 

56 

16 

80 

5 

3 

7 

31 

21 

98 

465 

b<2) 

54 

82 

90 

26 

59 

933 

87 

93 

61 

3 

64 

924 

68 

37 

50 

12 

86 

759 

COLUMNS 

1 

2 

3 

4 

5 

RHS 

EH 

211 

231 

231 

211 

211 

on 

52 

89 

88 

33 

73 

73 

72 

35 

90 

28 

894 

(4) 
BV  ' 

88 

14 

59 

19 

86 

798 

39 

92 

3 

79 

18 

693 

58 

32 

48 

15 

99 

756 

COLUMNS 

COLUMNS 

1 

2 

3 

4 

5 

RHS 

1 

2 

3 

4 

5 

RHS 

B2H 

97 

97 

168 

168 

174 

B 

EH 

174 

134 

134 

308 

308 

17 

64 

32 

96 

35 

1 

EH 

9 

76 

62 

51 

79 

62 

11 

71 

37 

93 

CM 

OJ 

CO 

99 

8 

73 

79 

91 

1050 

b(5) 

74 

10 

26 

0 

85 

585 

b<6> 

59 

24 

15 

56 

76 

690 

12 

20 

20 

55 

24 

395 

50 

30 

30 

99 

51 

780 

6 

57 

54 

67 

32 

648 

21 

32 

36 

71 

4l 

603 

Four-Subproblem  Derivative 


Linking  Constraint 
Right-band  Side 


Tightness 

Ratio 

0.33 

0.67 

1.00 

1.33 

1041 

2082 

3123 

4l64 

Tightness  Ratio  = O.67 


Number  of  Subproblems 
2 4 6 


Linking  Constraint 
Right-hand  Side 


958  2082 


3124 


9m 


TABLE  A -IV 
Test  Problem  4 


COLUMNS 

1 

2 

3 

4 

5 

RHS 

56 

113 

30 

62 

210 

A(1) 

4o 

91 

10 

30 

160 

16 

92 

4l 

16 

150 

221 

B<lJ 

38 

39 

32 

71 

80 

182 

8 

71 

30 

60 

200 

258 

38 

52 

30 

42 

170 

232 

COLUMNS 

1 

2 

3 

4 

5 

RHS 

32 

20 

4 

3 

43 

a<5) 

9 

25 

1 

1 

10 

12 

8 

2 

1 

0 

16 

b(3> 

30 

15 

0 

1 

23 

48 

31 

6 

3 

0 

18 

4l 

21 

4 

1 

2 

14 

29 

J2T 

T2T 


,(2) 


43 

20 

23 

26 

18 

9 


COLUMNS 
2 3 4 

7 33  5 


3 12 

4 18 

5 4o 

6 30 
7 20 


6 

8 

4 

0 


w 


COLUMNS 

12  3 4 


426  42  12 


W 


8 


280  10 


8 


,(*> 


200  20  6 2 

100  0 20  3 

60  21  4 0 

310  8 4 6 


COLUMNS 


1 

2 

3 

4 

5 

RHS 

c<5) 

63 

13 

42 

9 

4 

a<5) 

49 

8 

21 

6 

1 

70 

9 

22 

4 

1 

74 

b<5> 

40 

6 

8 

0 

6 

42 

32 

15 

31 

2 

2 

57 

18 

15 

38 

10 

4 

60 

JZT 


W 


,(6) 


10 


5 

4 

7 

8 


COLUMNS 
2 3 4 

22  8 9 

10  8 2 

10  6 4 

22  4 6 

8 2 8 

6 0 0 


5 KHS 
12 
18 

0 36 

12  64  | 

8 46 

3 27 


5 RHS 
2 
1 

1 160 
0 86 
2 61 

1 230 


5 RHS 

3 

1 

0 18 

1 26 

0 18 

3 12 
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